00000001:02000400:1.0F:1787603706.999790:0:2956:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787603715.897025:0:3158:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1787603716.766150:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1315 MB/s 00000001:01000000:0.0:1787603717.016051:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1723 MB/s 00000001:01000000:0.0:1787603717.265905:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10467 MB/s 00000020:02000000:0.0:1787603717.535566:0:3250:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_ged04d84 00000400:02000000:0.0:1787603717.887089:0:3265:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.121@tcp [8/256/0/180] 00008000:02000000:3.0F:1787603721.661558:0:3415:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787603779.811453:0:5222:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787603790.110715:0:5802:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787603790.110722:0:5802:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787603790.110886:0:5802:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d623b54b 00000080:02000400:0.0:1787603790.110900:0:5802:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787603790.125266:0:5802:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787603790.125279:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787603790.125319:0:5802:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000174d5d21) 00000020:00000080:0.0:1787603790.125352:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787603790.152643:0:5802:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787603790.153452:0:5802:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787603790.173962:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787603790.174003:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787603790.174027:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787603790.174076:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787603790.174106:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787603790.174586:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787603790.174595:0:5802:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787603790.174609:0:5802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a19010f7 00000020:01000004:3.0:1787603790.174617:0:5802:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787603790.174622:0:5802:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787603790.174628:0:5802:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d623b54b from MGS 00000020:01000004:3.0:1787603790.174633:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787603790.174653:0:5802:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c7d7322c) 00000020:00000080:3.0:1787603790.174665:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787603790.174738:0:5802:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d623b54b from MGS, refs=2 00080000:01000000:3.0:1787603790.174743:0:5802:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787603790.174747:0:5802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a1901105 00000100:00100000:3.0:1787603790.174950:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787603790.175091:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787603790.175097:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787603790.175735:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787603790.175743:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787603790.176609:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787603790.176767:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787603790.176772:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787603790.177439:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787603790.177445:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787603790.177751:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787603790.177756:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787603790.178364:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603790.178367:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603790.178369:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603790.178709:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603790.178711:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603790.178712:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603790.179239:0:5802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787603790.185595:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787603790.428919:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2599 MB/s 00000001:01000000:0.0:1787603790.680425:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1565 MB/s 00000001:01000000:0.0:1787603790.930183:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 455 MB/s 00000001:01000000:1.0:1787603791.180498:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 599 MB/s 00080000:10000000:1.0:1787603791.187139:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1787603791.191140:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787603791.202464:0:5802:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787603791.202487:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787603791.202491:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787603791.203192:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787603791.203265:0:5802:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787603791.203423:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787603791.203691:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787603791.203718:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787603791.205721:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787603791.205937:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787603791.205943:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787603791.208879:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787603791.208899:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787603791.209265:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787603791.209273:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787603791.211299:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787603791.211346:0:5802:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.121@tcp' 00000020:01000004:3.0:1787603791.211348:0:5802:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787603791.211409:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.121@tcp (typ=mgc) 00000020:00000080:3.0:1787603791.211426:0:5802:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.121@tcp (00000000b2924a49) 00000020:00000080:3.0:1787603791.211448:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787603791.211546:0:5802:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000034a44b98@MGC192.168.202.121@tcp: add connection 192.168.202.121@tcp at head 00010000:00010000:3.0:1787603791.211756:0:5802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.121@tcp-0 is initialized 00000040:01000000:3.0:1787603791.211764:0:5802:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.121@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787603791.214450:0:5817:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787603791.215255:0:5818:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787603791.216275:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.121@tcp (uuid 9a643876-f930-492c-81cb-9dcff9ce6b60) 00000020:00000080:3.0:1787603791.216388:0:5802:0:(genops.c:1385:class_connect()) connect: client 9a643876-f930-492c-81cb-9dcff9ce6b60, cookie 0xb5d1f3b1a1901113 00000100:00080000:3.0:1787603791.216406:0:5802:0:(import.c:510:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787603791.216412:0:5802:0:(import.c:624:import_select_connection()) MGC192.168.202.121@tcp: import 0000000034a44b98 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:3.0:1787603791.216473:0:5802:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008bd842e8 x1874438355157120/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787603791.216496:0:5802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9a643876-f930-492c-81cb-9dcff9ce6b60->MGS 00000020:01000004:3.0:1787603791.216525:0:5802:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787603791.216555:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787603791.216571:0:5802:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000976369b9) 00000020:00000080:3.0:1787603791.216586:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787603791.218475:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008bd842e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a643876-f930-492c-81cb-9dcff9ce6b60:3280:1874438355157120:0@lo:250: 00000100:00100000:2.0:1787603791.218581:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603791.218787:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355157120 00000100:00100000:1.0:1787603791.218797:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355157120 00000100:00100000:1.0:1787603791.219262:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787603791.219272:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000940c888 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3280:x1874438355157120:12345-0@lo:250: 00010000:00080000:1.0:1787603791.219309:0:5813:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9a643876-f930-492c-81cb-9dcff9ce6b60@0@lo t0 exp 0000000000000000 cur 124 last 0 00000020:00000080:1.0:1787603791.219357:0:5813:0:(genops.c:1385:class_connect()) connect: client 9a643876-f930-492c-81cb-9dcff9ce6b60, cookie 0xb5d1f3b1a1901121 00000100:00080000:1.0:1787603791.221003:0:5813:0:(import.c:65:import_set_state_nolock()) 0000000091186044 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787603791.221777:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000940c888 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+5:3280:x1874438355157120:12345-0@lo:250: Request processed in 2499us (3191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603791.221792:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787603791.227498:0:3280:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787603791.227525:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.121@tcp: connect to target with instance 0 00000100:00080000:0.0:1787603791.228933:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787603791.228948:0:3280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787603791.228954:0:3280:0:(import.c:65:import_set_state_nolock()) 0000000034a44b98 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787603791.228960:0:3280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787603791.228972:0:3280:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787603791.228985:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008bd842e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a643876-f930-492c-81cb-9dcff9ce6b60:3280:1874438355157120:0@lo:250: 00000100:00100000:3.0:1787603791.248803:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787603791.249063:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787603791.249076:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787603791.257592:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787603791.257614:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787603791.259283:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787603791.259298:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787603791.263569:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787603791.263772:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787603791.263778:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787603791.268243:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787603791.268263:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787603791.334610:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787603791.335091:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787603791.335176:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787603791.339369:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787603791.339382:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787603791.340911:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787603791.341106:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787603791.341113:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787603791.345492:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787603791.345507:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787603791.346211:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787603791.346417:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787603791.346422:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787603791.349034:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787603791.349050:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787603791.349690:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787603791.349933:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787603791.349939:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787603791.350675:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787603791.350682:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787603791.393319:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787603791.393550:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787603791.393557:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787603791.395375:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787603791.395390:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787603791.396717:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787603791.396730:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787603791.407685:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787603791.407711:0:5802:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787603791.407717:0:5802:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787603791.407922:0:5802:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.121@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787603791.407955:0:5802:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.121@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787603791.407959:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787603791.407965:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787603791.407966:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787603791.407967:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787603791.407968:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787603791.407969:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787603791.407971:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787603791.407972:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787603791.407973:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787603791.407975:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787603791.407976:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787603791.407977:0:5802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787603791.407980:0:5802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787603791.407982:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787603791.407983:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787603791.407984:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787603791.407985:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787603791.407986:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787603791.407987:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787603791.407988:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787603791.407989:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787603791.407990:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787603791.407990:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787603791.407991:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787603791.407992:0:5802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787603791.408023:0:5802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787603791.408038:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099977dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355157248:0@lo:253: 00000100:00100000:0.0:1787603791.408307:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603791.408496:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 000000009516a340 going to sleep for 11 seconds 00000100:00100000:3.0:1787603791.411233:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355157248 00000100:00100000:3.0:1787603791.411250:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355157248 00000100:00100000:3.0:1787603791.411305:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787603791.411316:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ad521a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+5:5802:x1874438355157248:12345-0@lo:253: 20000000:01000000:3.0:1787603791.411390:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787603791.411393:0:5816:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787603791.412035:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787603791.412167:0:5816:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787603791.417178:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787603791.418998:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787603791.419217:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787603791.419222:0:5816:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787603791.419227:0:5816:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787603791.419230:0:5816:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787603791.419259:0:5816:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787603791.419535:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787603791.419778:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787603791.419793:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787603791.419880:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787603791.419944:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787603791.419982:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787603791.420073:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787603791.420083:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787603791.420129:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787603791.420137:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787603791.420168:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787603791.420176:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787603791.420206:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787603791.420257:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787603791.420289:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787603791.420295:0:5816:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787603791.420309:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787603791.420557:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787603791.420568:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787603791.420618:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787603791.420656:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787603791.420708:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787603791.420721:0:5816:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787603791.420798:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787603791.420807:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787603791.420925:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787603791.420975:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787603791.421013:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787603791.421026:0:5816:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787603791.421213:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787603791.421224:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787603791.421270:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787603791.421306:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787603791.421487:0:5816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787603791.421532:0:5816:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787603791.421539:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787603791.425222:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787603791.428675:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787603791.428711:0:5816:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.121@tcp for mdt 20000000:01000000:0.0:1787603791.428713:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.121@tcp (null) (null) (null) 00000040:00080000:0.0:1787603791.428745:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787603791.428752:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787603791.428775:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787603791.428781:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.121@tcp (null) (null) 00000040:00080000:0.0:1787603791.428821:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787603791.428830:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787603791.428889:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787603791.428918:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787603791.429090:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787603791.429093:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787603791.429099:0:5816:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787603791.429106:0:5816:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787603791.429925:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1787603791.430155:0:5816:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787603791.437773:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787603791.437829:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1787603791.437952:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1787603791.437972:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787603791.437975:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787603791.437979:0:5816:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787603791.437992:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787603791.437995:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787603791.438028:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787603791.438030:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787603791.440415:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787603791.441678:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787603791.441733:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787603791.441765:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1787603791.441778:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787603791.441780:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787603791.444667:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1787603791.445090:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1787603791.445158:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1787603791.445235:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1787603791.445547:0:5816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787603791.445550:0:5816:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1787603791.445558:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787603791.445580:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901128 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.445596:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901128 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.445618:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901128 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.445623:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901128 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.445628:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901128 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.445633:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901128 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.445637:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005dbc886c already unused, calling callback (000000006fd7915f) 00010000:00010000:1.0:1787603791.445641:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901128 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.445647:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901128 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.445658:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901128 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.445663:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901128 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.445669:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901128 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787603791.445685:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787603791.719977:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ad521a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+5:5802:x1874438355157248:12345-0@lo:253: Request processed in 308654us (311663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603791.720000:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787603791.720042:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099977dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355157248:0@lo:253: 10000000:01000000:3.0:1787603791.720059:0:5802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787603791.720063:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787603791.720065:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787603791.720066:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787603791.720068:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787603791.720069:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787603791.720070:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787603791.720071:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787603791.720073:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787603791.720074:0:5802:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787603791.720075:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787603791.720077:0:5802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787603791.720100:0:5802:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d623b54b from lustre-MDT0000 10000000:01000000:3.0:1787603791.720124:0:5802:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787603791.720128:0:5802:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787603791.720132:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ed28654cd28 10000000:01000000:3.0:1787603791.720136:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787603791.720144:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ed28654cd28 from 1 10000000:01000000:3.0:1787603791.720147:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787603791.720198:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: 00000000323a62c2/0xb5d1f3b1a190112f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603791.720208:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: 00000000323a62c2/0xb5d1f3b1a190112f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603791.720217:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: 00000000323a62c2/0xb5d1f3b1a190112f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603791.720234:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355157376:0@lo:101: 00000100:00100000:3.0:1787603791.720307:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603791.720353:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355157376 00000100:00100000:3.0:1787603791.720355:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0828bb2 going to sleep for 11 seconds 00000100:00100000:1.0:1787603791.720362:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355157376 00000100:00100000:1.0:1787603791.720403:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787603791.720411:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000308d072 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+5:5802:x1874438355157376:12345-0@lo:101: 00010000:00010000:1.0:1787603791.720423:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603791.720436:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901136 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190112f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.720460:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190112f expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.720469:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005dbc886c/0xb5d1f3b1a1901136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190112f expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603791.720478:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005dbc886c, rc 0) 00000100:00100000:1.0:1787603791.720523:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000308d072 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+6:5802:x1874438355157376:12345-0@lo:101: Request processed in 112us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603791.720528:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787603791.720550:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355157376:0@lo:101: 00010000:00010000:3.0:1787603791.720562:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: 00000000323a62c2/0xb5d1f3b1a190112f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901136 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603791.720570:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: 00000000323a62c2/0xb5d1f3b1a190112f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901136 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603791.720612:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355157504:0@lo:501: 00000100:00100000:3.0:1787603791.720637:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603791.720655:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0828bb2 going to sleep for 11 seconds 00000100:00100000:0.0:1787603791.720686:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355157504 00000100:00100000:0.0:1787603791.720691:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355157504 00000100:00100000:0.0:1787603791.720722:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787603791.720728:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000220140aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+6:5802:x1874438355157504:12345-0@lo:501: 00000100:00100000:3.0:1787603791.721525:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355157504:0@lo:501: 00000100:00100000:0.0:1787603791.721525:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000220140aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+6:5802:x1874438355157504:12345-0@lo:501: Request processed in 796us (886us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787603791.721532:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:01000000:3.0:1787603791.721551:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787603791.721560:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: 00000000323a62c2/0xb5d1f3b1a190112f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901136 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603791.721567:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: 00000000323a62c2/0xb5d1f3b1a190112f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901136 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603791.721583:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ed29010d000 10000000:01000000:3.0:1787603791.721587:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787603791.721591:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ed29010d000 10000000:01000000:3.0:1787603791.721594:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787603791.721596:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ed29010d000 from 1 10000000:01000000:3.0:1787603791.721599:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787603791.721619:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: 00000000bae4147f/0xb5d1f3b1a190113d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603791.721626:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: 00000000bae4147f/0xb5d1f3b1a190113d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603791.721634:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: 00000000bae4147f/0xb5d1f3b1a190113d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603791.721647:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355157632:0@lo:101: 00000100:00100000:3.0:1787603791.721677:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603791.721707:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0828bb2 going to sleep for 11 seconds 00000100:00100000:0.0:1787603791.721783:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355157632 00000100:00100000:0.0:1787603791.721788:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355157632 00000100:00100000:0.0:1787603791.721891:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787603791.721899:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+6:5802:x1874438355157632:12345-0@lo:101: 00010000:00010000:0.0:1787603791.721908:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603791.721921:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004cb1b019/0xb5d1f3b1a1901144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190113d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603791.721937:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004cb1b019/0xb5d1f3b1a1901144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190113d expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603791.721945:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004cb1b019/0xb5d1f3b1a1901144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190113d expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603791.721962:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004cb1b019, rc 0) 00000100:00100000:0.0:1787603791.722042:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+7:5802:x1874438355157632:12345-0@lo:101: Request processed in 144us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603791.722048:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787603791.722536:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355157632:0@lo:101: 00010000:00010000:3.0:1787603791.722548:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: 00000000bae4147f/0xb5d1f3b1a190113d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603791.722556:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: 00000000bae4147f/0xb5d1f3b1a190113d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603791.722569:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787603791.722654:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: 00000000bae4147f/0xb5d1f3b1a190113d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603791.722674:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: 00000000bae4147f/0xb5d1f3b1a190113d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603791.722680:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787603791.722684:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787603791.722689:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ed29010d000 10000000:01000000:3.0:1787603791.722691:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787603791.722694:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787603791.722696:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787603791.722711:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: 000000001b63c6df/0xb5d1f3b1a190114b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603791.722717:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: 000000001b63c6df/0xb5d1f3b1a190114b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603791.722724:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: 000000001b63c6df/0xb5d1f3b1a190114b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603791.722736:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355157760:0@lo:101: 00000100:00100000:3.0:1787603791.722768:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603791.722906:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0828bb2 going to sleep for 11 seconds 00000100:00100000:2.0:1787603791.723039:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355157760 00000100:00100000:2.0:1787603791.723045:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355157760 00000100:00100000:2.0:1787603791.723125:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787603791.723132:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008107ebf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+7:5802:x1874438355157760:12345-0@lo:101: 00010000:00010000:2.0:1787603791.723140:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603791.723149:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003f320da7/0xb5d1f3b1a1901152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190114b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603791.723164:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f320da7/0xb5d1f3b1a1901152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190114b expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603791.723172:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003f320da7/0xb5d1f3b1a1901152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190114b expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603791.723179:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003f320da7, rc 0) 00000100:00100000:2.0:1787603791.723221:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008107ebf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+8:5802:x1874438355157760:12345-0@lo:101: Request processed in 90us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603791.723227:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787603791.723293:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355157760:0@lo:101: 00010000:00010000:3.0:1787603791.723304:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: 000000001b63c6df/0xb5d1f3b1a190114b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901152 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603791.723310:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: 000000001b63c6df/0xb5d1f3b1a190114b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901152 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603791.723373:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355157888:0@lo:501: 00000100:00100000:3.0:1787603791.723399:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603791.723546:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0828bb2 going to sleep for 11 seconds 00000100:00100000:1.0:1787603791.724437:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355157888 00000100:00100000:1.0:1787603791.724447:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355157888 00000100:00100000:1.0:1787603791.724482:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787603791.724489:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050f07320 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+8:5802:x1874438355157888:12345-0@lo:501: 00000100:00100000:1.0:1787603791.724773:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050f07320 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+9:5802:x1874438355157888:12345-0@lo:501: Request processed in 284us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603791.724780:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787603791.724882:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355157888:0@lo:501: 00000100:00100000:3.0:1787603791.724919:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355158016:0@lo:503: 00000100:00100000:3.0:1787603791.724957:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603791.724985:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0828bb2 going to sleep for 11 seconds 00000100:00100000:1.0:1787603791.725201:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355158016 00000100:00100000:1.0:1787603791.725206:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355158016 00000100:00100000:1.0:1787603791.725225:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787603791.725230:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002abdfe32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+9:5802:x1874438355158016:12345-0@lo:503: 00000100:00100000:1.0:1787603791.725414:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002abdfe32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+9:5802:x1874438355158016:12345-0@lo:503: Request processed in 183us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603791.725428:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787603791.725646:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355158016:0@lo:503: 00000100:00100000:2.0:1787603791.726367:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc4269b4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:5845:1874438355158144:0@lo:502: 00000100:00100000:2.0:1787603791.726428:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603791.726476:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072b90fba going to sleep for 11 seconds 00000100:00100000:1.0:1787603791.726623:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355158144 00000100:00100000:1.0:1787603791.726630:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355158144 00000100:00100000:1.0:1787603791.726821:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787603791.726828:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d56fbdbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+9:5845:x1874438355158144:12345-0@lo:502: 00000100:00100000:1.0:1787603791.727051:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d56fbdbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+9:5845:x1874438355158144:12345-0@lo:502: Request processed in 223us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603791.727060:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787603791.727159:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc4269b4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:5845:1874438355158144:0@lo:502: 00000020:01000000:3.0:1787603791.727189:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787603791.727201:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603791.727204:0:5845:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787603791.727209:0:5845:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787603791.727212:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787603791.727227:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c9160bc6) 00000020:00000080:3.0:1787603791.727397:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787603791.727408:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787603791.727492:0:5845:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787603791.727501:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a1901160 00000020:00000080:3.0:1787603791.727934:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787603791.727939:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603791.727944:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603791.727945:0:5845:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787603791.727948:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787603791.727952:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603791.727953:0:5845:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787603791.727957:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787603791.727976:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000003e34072a) 00000020:00000080:3.0:1787603791.727988:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787603791.727993:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787603791.727995:0:5845:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787603791.727998:0:5845:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787603791.728003:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787603791.728058:0:5845:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d623b54b from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787603791.728071:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001bd917cb) 00000020:00000080:3.0:1787603791.728080:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787603791.728130:0:5845:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787603791.728136:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb5d1f3b1a1901175 00000020:00000080:3.0:1787603791.728389:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787603791.728397:0:5845:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787603791.728402:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb5d1f3b1a190117c 00080000:01000000:3.0:1787603791.728407:0:5845:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787603791.728411:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a1901183 00080000:10000000:3.0:1787603791.728795:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787603791.729231:0:5845:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787603791.734369:0:5845:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787603791.801675:0:5845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787603791.802705:0:5845:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787603791.809448:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787603791.810032:0:5845:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787603791.842875:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000706788ce) 00000020:00000080:0.0:1787603791.842897:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787603791.843367:0:5845:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787603791.843377:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a1901191 00000020:00000080:0.0:1787603791.845454:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787603791.853354:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787603791.926018:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787603792.027683:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787603792.136380:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:0.0:1787603792.215192:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1787603792.230035:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787603792.291567:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787603792.352530:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb5d1f3b1a1901198 00000020:00000080:3.0:1787603792.353580:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787603792.353598:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603792.353606:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603792.353609:0:5845:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787603792.353615:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787603792.353624:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603792.353626:0:5845:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787603792.353631:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787603792.353682:0:5845:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787603792.353701:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603792.353705:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603792.353718:0:5845:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787603792.353721:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787603792.353724:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603792.353726:0:5845:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787603792.353729:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787603792.353731:0:5845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787603792.353792:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:5845:1874438355158272:0@lo:502: 00000100:00100000:3.0:1787603792.353935:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603792.354011:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set 000000005314840d going to sleep for 11 seconds 00000100:00100000:0.0:1787603792.355897:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355158272 00000100:00100000:0.0:1787603792.355918:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355158272 00000100:00100000:0.0:1787603792.355996:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787603792.356007:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034771c8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+9:5845:x1874438355158272:12345-0@lo:502: 00000100:00100000:0.0:1787603792.356586:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034771c8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+9:5845:x1874438355158272:12345-0@lo:502: Request processed in 579us (2651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603792.356596:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787603792.356817:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2512008 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:5845:1874438355158272:0@lo:502: 00000020:01000000:3.0:1787603792.356891:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603792.356901:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603792.356903:0:5845:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787603792.356910:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787603792.357295:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787603792.357328:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787603792.357393:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: 000000001b63c6df/0xb5d1f3b1a190114b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901152 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.357406:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: 000000001b63c6df/0xb5d1f3b1a190114b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901152 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603792.357415:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ed29010d000 from 1 10000000:01000000:0.0:1787603792.357418:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787603792.357464:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.357494:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.357505:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603792.357527:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355158400:0@lo:101: 00000100:00100000:0.0:1787603792.357585:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603792.357637:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a052d81c going to sleep for 11 seconds 00000100:00100000:3.0:1787603792.361508:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355158400 00000100:00100000:3.0:1787603792.361530:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355158400 00000100:00100000:3.0:1787603792.361597:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787603792.361608:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d648730 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+9:5802:x1874438355158400:12345-0@lo:101: 00010000:00010000:3.0:1787603792.361632:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603792.361664:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000077678fd/0xb5d1f3b1a19011a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190119f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603792.361699:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000077678fd/0xb5d1f3b1a19011a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190119f expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603792.361710:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000077678fd/0xb5d1f3b1a19011a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190119f expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603792.361720:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000077678fd, rc 0) 00000100:00100000:3.0:1787603792.361817:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d648730 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+10:5802:x1874438355158400:12345-0@lo:101: Request processed in 211us (4233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603792.361864:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787603792.362567:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355158400:0@lo:101: 00010000:00010000:0.0:1787603792.362594:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19011a6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.362607:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19011a6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603792.363454:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355158528:0@lo:256: 00000100:00100000:0.0:1787603792.363537:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603792.363678:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a052d81c going to sleep for 11 seconds 00000100:00100000:1.0:1787603792.366016:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355158528 00000100:00100000:1.0:1787603792.366037:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355158528 00000100:00100000:1.0:1787603792.370478:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787603792.370503:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ccaae89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+10:5802:x1874438355158528:12345-0@lo:256: 20000000:01000000:1.0:1787603792.370548:0:5813:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787603792.370557:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787603792.370737:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ccaae89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+10:5802:x1874438355158528:12345-0@lo:256: Request processed in 245us (7200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603792.370746:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787603792.375411:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355158528:0@lo:256: 10000000:01000000:0.0:1787603792.376076:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787603792.376105:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19011a6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.376117:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19011a6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603792.376746:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed29010d000 from 1 10000000:01000000:0.0:1787603792.376750:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787603792.376805:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.376811:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.376822:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603792.376872:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355158656:0@lo:101: 00000100:00100000:0.0:1787603792.376960:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603792.377642:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a052d81c going to sleep for 11 seconds 00000100:00100000:2.0:1787603792.377745:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355158656 00000100:00100000:2.0:1787603792.377756:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355158656 00000100:00100000:2.0:1787603792.377805:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787603792.377813:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5f3051c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+10:5802:x1874438355158656:12345-0@lo:101: 00010000:00010000:2.0:1787603792.377829:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603792.377860:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b6da930b/0xb5d1f3b1a19011b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19011ad expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603792.377891:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b6da930b/0xb5d1f3b1a19011b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19011ad expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603792.377901:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b6da930b/0xb5d1f3b1a19011b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19011ad expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603792.377911:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b6da930b, rc 0) 00000100:00100000:2.0:1787603792.377965:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5f3051c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+11:5802:x1874438355158656:12345-0@lo:101: Request processed in 153us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603792.377973:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787603792.381960:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355158656:0@lo:101: 00010000:00010000:0.0:1787603792.382017:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19011b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.382033:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19011b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603792.382183:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355158784:0@lo:501: 00000100:00100000:0.0:1787603792.382277:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603792.382341:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a052d81c going to sleep for 11 seconds 00000100:00100000:2.0:1787603792.382635:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355158784 00000100:00100000:2.0:1787603792.382645:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355158784 00000100:00100000:2.0:1787603792.382718:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787603792.382729:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008be34577 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+11:5802:x1874438355158784:12345-0@lo:501: 00000100:00100000:2.0:1787603792.383771:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008be34577 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+11:5802:x1874438355158784:12345-0@lo:501: Request processed in 1038us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603792.383784:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787603792.384373:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355158784:0@lo:501: 00000100:00100000:0.0:1787603792.384437:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355158912:0@lo:503: 00000100:00100000:0.0:1787603792.384507:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603792.384557:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a052d81c going to sleep for 11 seconds 00000100:00100000:2.0:1787603792.384620:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355158912 00000100:00100000:2.0:1787603792.384627:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355158912 00000100:00100000:2.0:1787603792.384720:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787603792.384731:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017699245 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+11:5802:x1874438355158912:12345-0@lo:503: 00000040:00080000:2.0:1787603792.384781:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787603792.384832:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017699245 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+11:5802:x1874438355158912:12345-0@lo:503: Request processed in 104us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603792.384862:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787603792.385041:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355158912:0@lo:503: 00000040:00080000:0.0:1787603792.388083:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787603792.389251:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787603792.389289:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787603792.389307:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19011b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.389334:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19011b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603792.389399:0:5802:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787603792.389402:0:5802:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ed29010d000 10000000:01000000:0.0:1787603792.389406:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ed29010d000 10000000:01000000:0.0:1787603792.389410:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787603792.389415:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ed29010d000 from 1 10000000:01000000:0.0:1787603792.389418:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787603792.389469:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: 0000000084e97929/0xb5d1f3b1a19011bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.389477:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: 0000000084e97929/0xb5d1f3b1a19011bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.389491:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: 0000000084e97929/0xb5d1f3b1a19011bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603792.389522:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355159040:0@lo:101: 00000100:00100000:0.0:1787603792.389621:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603792.391768:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd481a76 going to sleep for 11 seconds 00000100:00100000:1.0:1787603792.393301:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355159040 00000100:00100000:1.0:1787603792.393332:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355159040 00000100:00100000:1.0:1787603792.393419:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787603792.393431:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e26b9ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+11:5802:x1874438355159040:12345-0@lo:101: 00010000:00010000:1.0:1787603792.393454:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603792.393478:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080131976/0xb5d1f3b1a19011c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19011bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.393542:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080131976/0xb5d1f3b1a19011c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19011bb expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.393555:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080131976/0xb5d1f3b1a19011c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19011bb expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.393566:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080131976, rc 0) 00000100:00100000:1.0:1787603792.393678:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e26b9ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5802:x1874438355159040:12345-0@lo:101: Request processed in 248us (4057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603792.393685:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787603792.395353:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355159040:0@lo:101: 00010000:00010000:0.0:1787603792.395388:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: 0000000084e97929/0xb5d1f3b1a19011bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19011c2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.395402:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: 0000000084e97929/0xb5d1f3b1a19011bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19011c2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603792.395506:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355159168:0@lo:501: 00000100:00100000:0.0:1787603792.395570:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603792.395628:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd481a76 going to sleep for 11 seconds 00000100:00100000:1.0:1787603792.395691:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355159168 00000100:00100000:1.0:1787603792.395699:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355159168 00000100:00100000:1.0:1787603792.395745:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787603792.395754:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089197c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5802:x1874438355159168:12345-0@lo:501: 00000100:00100000:1.0:1787603792.396145:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089197c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5802:x1874438355159168:12345-0@lo:501: Request processed in 390us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603792.396154:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787603792.397919:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355159168:0@lo:501: 00000100:00100000:0.0:1787603792.397998:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355159296:0@lo:503: 00000100:00100000:0.0:1787603792.398107:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603792.398134:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd481a76 going to sleep for 11 seconds 00000100:00100000:1.0:1787603792.398393:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355159296 00000100:00100000:1.0:1787603792.398403:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355159296 00000100:00100000:1.0:1787603792.398457:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787603792.398467:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000153ba161 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5802:x1874438355159296:12345-0@lo:503: 00000100:00100000:1.0:1787603792.398725:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000153ba161 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5802:x1874438355159296:12345-0@lo:503: Request processed in 258us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603792.398735:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787603792.399026:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355159296:0@lo:503: 00000100:00100000:0.0:1787603792.399672:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:5850:1874438355159424:0@lo:502: 00000100:00100000:0.0:1787603792.399737:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603792.399781:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e3fb18c going to sleep for 11 seconds 00000100:00100000:1.0:1787603792.399830:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355159424 00000100:00100000:1.0:1787603792.399870:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355159424 00000100:00100000:1.0:1787603792.399911:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787603792.399927:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073db3883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5850:x1874438355159424:12345-0@lo:502: 00000100:00100000:1.0:1787603792.400295:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073db3883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5850:x1874438355159424:12345-0@lo:502: Request processed in 368us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603792.400305:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787603792.400440:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:5850:1874438355159424:0@lo:502: 00000020:01000004:0.0:1787603792.400515:0:5850:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787603792.400536:0:5850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b64df343) 00000020:00000080:0.0:1787603792.400578:0:5850:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787603792.400682:0:5850:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d623b54b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787603792.400686:0:5850:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d623b54b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787603792.400689:0:5850:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d623b54b 4 00010000:00080000:0.0:1787603792.400734:0:5850:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a3110289@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.121@tcp at head 00010000:00010000:1.0:1787603792.408262:0:5850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787603792.408522:0:5850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787603792.408573:0:5850:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787603792.408591:0:5850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb5d1f3b1a19011d0 00000100:00080000:1.0:1787603792.408605:0:5850:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787603792.408612:0:5850:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a3110289 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:1.0:1787603792.408672:0:5850:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000069f9753b x1874438355159552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787603792.408707:0:5850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787603792.408954:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069f9753b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874438355159552:0@lo:38: 00000100:00100000:3.0:1787603792.409067:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603792.410140:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355159552 00000100:00100000:1.0:1787603792.410153:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355159552 00000100:00100000:1.0:1787603792.410204:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787603792.410214:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2512008 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874438355159552:12345-0@lo:38: 00000100:00100000:1.0:1787603792.410326:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2512008 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874438355159552:12345-0@lo:38: Request processed in 102us (1250us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787603792.410334:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787603792.410388:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787603792.410398:0:3280:0:(import.c:65:import_set_state_nolock()) 00000000a3110289 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787603792.410402:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787603792.410406:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069f9753b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874438355159552:0@lo:38: 00000100:00100000:1.0:1787603792.413453:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000069f9753b pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:5850:1874438355159680:0@lo:502: 00000100:00100000:1.0:1787603792.413563:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603792.416768:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 000000004718465b going to sleep for 11 seconds 00000100:00100000:2.0:1787603792.419518:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355159680 00000100:00100000:2.0:1787603792.419541:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355159680 00000100:00100000:2.0:1787603792.419648:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787603792.419660:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008537fe82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5850:x1874438355159680:12345-0@lo:502: 00000100:00100000:2.0:1787603792.420031:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008537fe82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5850:x1874438355159680:12345-0@lo:502: Request processed in 371us (6467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603792.420041:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787603792.421349:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000069f9753b pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:5850:1874438355159680:0@lo:502: 00000040:00080000:3.0:1787603792.421408:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787603792.421896:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787603792.421922:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787603792.421937:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: 0000000084e97929/0xb5d1f3b1a19011bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19011c2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.421950:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: 0000000084e97929/0xb5d1f3b1a19011bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19011c2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787603792.422007:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787603792.422010:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787603792.422012:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787603792.422013:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787603792.422014:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787603792.422016:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787603792.422017:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787603792.422018:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787603792.422020:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787603792.422021:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787603792.422022:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787603792.422024:0:5802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787603792.422028:0:5802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787603792.422030:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787603792.422032:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787603792.422033:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787603792.422034:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787603792.422035:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787603792.422036:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787603792.422037:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787603792.422038:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787603792.422039:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787603792.422040:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787603792.422041:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787603792.422042:0:5802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787603792.422069:0:5802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787603792.422087:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355159808:0@lo:253: 00000100:00100000:0.0:1787603792.422250:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603792.422674:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057fe3969 going to sleep for 11 seconds 00000100:00100000:1.0:1787603792.425168:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355159808 00000100:00100000:1.0:1787603792.425186:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355159808 00000100:00100000:1.0:1787603792.425249:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787603792.425259:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd2df7c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5802:x1874438355159808:12345-0@lo:253: 20000000:01000000:1.0:1787603792.425333:0:5813:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787603792.425353:0:5813:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787603792.459457:0:5813:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787603792.459520:0:5813:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787603792.459661:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787603792.459668:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787603792.459695:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603792.459720:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000077678fd/0xb5d1f3b1a19011a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190119f expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603792.459729:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603792.459804:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000077678fd/0xb5d1f3b1a19011a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190119f expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603792.459823:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000077678fd/0xb5d1f3b1a19011a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190119f expref: 12 pid: 5816 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603792.459872:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000018d5fa2a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1874438355159936:0@lo:104: 00000100:00100000:2.0:1787603792.459968:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603792.460239:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 000000005182e13e going to sleep for 11 seconds 00000100:00100000:1.0:1787603792.460293:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355159936 00000100:00100000:1.0:1787603792.460305:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355159936 00000100:00100000:1.0:1787603792.461418:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787603792.461434:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d35be4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+3:5838:x1874438355159936:12345-0@lo:104: 00010000:00010000:1.0:1787603792.461456:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19011a6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.461552:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787603792.461557:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d35be4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+3:5838:x1874438355159936:12345-0@lo:104: Request processed in 129us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603792.461565:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787603792.461595:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787603792.461601:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19011a6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.461609:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a784cf7f already unused, calling callback (000000007318544f) 10000000:00010000:1.0:1787603792.461613:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19011a6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.461621:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19011a6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787603792.461648:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19011a6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603792.461653:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787603792.461692:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19011a6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.461699:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787603792.461720:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19011a6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.461726:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: 00000000a784cf7f/0xb5d1f3b1a190119f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19011a6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.461749:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603792.461751:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603792.461752:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603792.461906:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000045d5116 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355160064:0@lo:103: 00000100:00100000:1.0:1787603792.461950:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603792.462010:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355160064 00000100:00100000:1.0:1787603792.462017:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355160064 00010000:00010000:1.0:1787603792.462041:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000077678fd/0xb5d1f3b1a19011a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190119f expref: 13 pid: 5816 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603792.462733:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787603792.462745:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c48e955 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:3282:x1874438355160064:12345-0@lo:103: 00010000:00010000:1.0:1787603792.462763:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603792.462769:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000077678fd/0xb5d1f3b1a19011a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190119f expref: 13 pid: 5816 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.462791:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000077678fd/0xb5d1f3b1a19011a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190119f expref: 13 pid: 5816 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.462812:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.462820:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787603792.462863:0:5806:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003196166s 00010000:00010000:1.0:1787603792.462866:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.462873:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.462880:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.462885:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.462891:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006d984db9 already unused, calling callback (000000006fd7915f) 00010000:00010000:1.0:1787603792.462894:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.462901:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.462909:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603792.462928:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603792.462982:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c48e955 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:3282:x1874438355160064:12345-0@lo:103: Request processed in 241us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603792.462989:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787603792.466987:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000077678fd/0xb5d1f3b1a19011a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190119f expref: 12 pid: 5816 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603792.467016:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000018d5fa2a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1874438355159936:0@lo:104: 00010000:00010000:0.0:1787603792.467053:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.467064:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.467069:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603792.467074:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006d984db9/0xb5d1f3b1a19011d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603792.467521:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000045d5116 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355160064:0@lo:103: 00000100:00100000:2.0:1787603792.468877:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd2df7c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+11:5802:x1874438355159808:12345-0@lo:253: Request processed in 43609us (46617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603792.468897:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787603792.469022:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:5802:1874438355159808:0@lo:253: 10000000:01000000:0.0:1787603792.469040:0:5802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787603792.469055:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787603792.469057:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787603792.469058:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787603792.469059:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787603792.469061:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787603792.469062:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787603792.469064:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787603792.469065:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787603792.469067:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787603792.469068:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787603792.469070:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787603792.469071:0:5802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787603792.469089:0:5802:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787603792.474687:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787603792.475624:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787603792.476279:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787603792.476509:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787603792.476753:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787603792.477034:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787603792.478203:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787603792.478425:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787603792.478645:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787603792.478884:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787603792.479113:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787603792.479355:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787603792.535334:0:5802:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787603792.573865:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787603792.574174:0:5856:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787603792.577010:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787603792.577188:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787603792.577609:0:5802:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787603792.577617:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787603792.577750:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1787603792.591999:0:5855:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787603792.592014:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1787603792.592737:0:5802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787603792.601904:0:5802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787603792.601996:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787603792.602476:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787603792.602959:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787603792.618264:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787603792.618596:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787603792.618748:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787603792.618940:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787603792.619084:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787603792.619259:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787603792.619424:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787603792.619567:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787603792.619753:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787603792.619945:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787603792.620109:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787603792.620276:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787603792.620443:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787603792.620586:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787603792.620739:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787603792.620934:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787603792.621283:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787603792.626682:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787603792.627009:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787603792.627311:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787603792.627492:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787603792.627669:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787603792.628598:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787603792.628815:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787603792.630301:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787603792.630525:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787603792.630687:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787603792.631031:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787603792.631273:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787603792.631437:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787603792.631613:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787603792.631757:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787603792.633671:0:5802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787603792.684436:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787603792.761716:0:5802:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787603792.761770:0:5802:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb26141c7f988 00100000:10000000:2.0:1787603792.761781:0:5802:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787603792.764572:0:5802:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787603792.764600:0:5802:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787603792.764619:0:5802:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1787603792.764659:0:5802:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787603792.828883:0:5856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787603792.829002:0:5856:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787603792.829007:0:5856:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787603793.242390:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603794.267391:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603795.288287:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603796.314892:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603797.335479:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787603797.464118:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787603797.464129:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ed29010d000 from 3 10000000:01000000:0.0:1787603797.464135:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787603797.464180:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: 000000001a921dad/0xb5d1f3b1a19011de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603797.464193:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: 000000001a921dad/0xb5d1f3b1a19011de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603797.464203:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: 000000001a921dad/0xb5d1f3b1a19011de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603797.464224:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355160192:0@lo:101: 00000100:00100000:0.0:1787603797.464377:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603797.464428:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf3dcd02 going to sleep for 11 seconds 00000100:00100000:3.0:1787603797.466134:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355160192 00000100:00100000:3.0:1787603797.466148:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355160192 00000100:00100000:3.0:1787603797.466210:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787603797.466219:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000887d7bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+11:5818:x1874438355160192:12345-0@lo:101: 00010000:00010000:3.0:1787603797.466237:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603797.466255:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000060f008f0/0xb5d1f3b1a19011e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19011de expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603797.466368:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060f008f0/0xb5d1f3b1a19011e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19011de expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603797.466393:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000060f008f0/0xb5d1f3b1a19011e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19011de expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603797.466402:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000060f008f0, rc 0) 00000100:00100000:3.0:1787603797.466474:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000887d7bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5818:x1874438355160192:12345-0@lo:101: Request processed in 257us (2098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603797.466482:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787603797.466552:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005915fd15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355160192:0@lo:101: 00010000:00010000:3.0:1787603797.466569:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: 000000001a921dad/0xb5d1f3b1a19011de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19011e5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603797.466577:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: 000000001a921dad/0xb5d1f3b1a19011de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19011e5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603797.466638:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065fbc313 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355160320:0@lo:256: 00000100:00100000:3.0:1787603797.466678:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603797.466710:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000003015e59a going to sleep for 11 seconds 00000100:00100000:3.0:1787603797.467902:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355160320 00000100:00100000:3.0:1787603797.467911:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355160320 00000100:00100000:3.0:1787603797.467953:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787603797.467960:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000aa945dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5818:x1874438355160320:12345-0@lo:256: 20000000:01000000:3.0:1787603797.467979:0:5813:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787603797.467996:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787603797.467999:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787603797.468169:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000aa945dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5818:x1874438355160320:12345-0@lo:256: Request processed in 209us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603797.468177:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787603797.468222:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065fbc313 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355160320:0@lo:256: 10000000:01000000:3.0:1787603797.469099:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787603797.469110:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: 000000001a921dad/0xb5d1f3b1a19011de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19011e5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603797.469122:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: 000000001a921dad/0xb5d1f3b1a19011de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19011e5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787603797.469366:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787603797.469372:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787603797.469382:0:37:0:(import.c:65:import_set_state_nolock()) 00000000a3110289 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787603797.469391:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a3110289 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:2.0:1787603797.469420:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005aea94ae x1874438355160448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787603797.469496:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005aea94ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874438355160448:0@lo:38: 00000100:00100000:1.0:1787603797.469545:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603797.471148:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355160448 00000100:00100000:3.0:1787603797.471159:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355160448 00000100:00100000:3.0:1787603797.471198:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787603797.471205:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000045d5116 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3280:x1874438355160448:12345-0@lo:38: 00010000:00080000:3.0:1787603797.471235:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 130 last 0 00000020:00000080:3.0:1787603797.471292:0:5823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb5d1f3b1a19011ec 00000004:00100000:3.0:1787603797.471339:0:5823:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787603797.471481:0:5823:0:(import.c:65:import_set_state_nolock()) 000000008ac4d1a2 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787603797.471561:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000045d5116 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874438355160448:12345-0@lo:38: Request processed in 355us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603797.471569:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787603797.473200:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005aea94ae x1874438355160448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787603807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787603797.473220:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787603797.473230:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787603797.473235:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787603797.473238:0:3280:0:(import.c:65:import_set_state_nolock()) 00000000a3110289 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787603797.473244:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005aea94ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874438355160448:0@lo:38: 00000001:02000400:3.0:1787603797.840931:0:6098:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787603798.360431:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603799.382973:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603800.407460:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603801.448280:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603802.457029:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603802.589533:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a8fd5e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355160704:0@lo:400: 00000100:00100000:2.0:1787603802.589613:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603802.589675:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787603802.589682:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065fbc313 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355160576:0@lo:400: 00000100:00100000:2.0:1787603802.589710:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603802.590292:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355160704 00000100:00100000:3.0:1787603802.590310:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355160704 00000100:00100000:3.0:1787603802.590364:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787603802.590372:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aea94ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355160704:12345-0@lo:400: 00000100:00100000:3.0:1787603802.590432:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aea94ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355160704:12345-0@lo:400: Request processed in 61us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603802.590438:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787603802.590479:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355160576 00000100:00100000:3.0:1787603802.590483:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355160576 00000100:00100000:3.0:1787603802.590504:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787603802.590509:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000989adb75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+12:3284:x1874438355160576:12345-0@lo:400: 00000100:00100000:3.0:1787603802.590535:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000989adb75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+12:3284:x1874438355160576:12345-0@lo:400: Request processed in 27us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603802.590541:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787603802.590638:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065fbc313 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355160576:0@lo:400: 00010000:00080000:2.0:1787603802.590651:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000a8fd5e0 x1874438355160704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603802.590662:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a8fd5e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355160704:0@lo:400: 00000020:00000080:3.0:1787603802.660254:0:6300:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5cd5d7d0 20000000:00000080:3.0:1787603802.660272:0:6300:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ed290083000 uarg=0000000000000000 20000000:01000000:3.0:1787603802.660302:0:6300:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787603802.660310:0:6300:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787603802.660315:0:6300:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787603802.660592:0:6300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787603802.660603:0:6300:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787603802.679497:0:6300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787603802.679768:0:6300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787603802.682103:0:6300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787603802.682240:0:6300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787603802.682261:0:6300:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787603802.682280:0:6300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.682302:0:6300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b6da930b/0xb5d1f3b1a19011b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19011ad expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.682309:0:6300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.682347:0:6300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b6da930b/0xb5d1f3b1a19011b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19011ad expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.682361:0:6300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b6da930b/0xb5d1f3b1a19011b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011ad expref: 11 pid: 5816 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603802.682375:0:6300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000582454d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6300:1874438355160832:0@lo:104: 00000100:00100000:2.0:1787603802.682440:0:6300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603802.682733:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355160832 00000100:00100000:3.0:1787603802.682750:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355160832 00000100:00100000:0.0:1787603802.688179:0:6300:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3db61f6 going to sleep for 11 seconds 00000100:00100000:2.0:1787603802.692410:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787603802.692436:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076b2eb92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+3:6300:x1874438355160832:12345-0@lo:104: 00010000:00010000:2.0:1787603802.692459:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19011b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.692585:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787603802.692590:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076b2eb92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+3:6300:x1874438355160832:12345-0@lo:104: Request processed in 168us (10150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603802.692598:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787603802.692733:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603802.692746:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19011b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603802.692761:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c6f3e7a2 already unused, calling callback (000000007318544f) 10000000:00010000:3.0:1787603802.692765:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19011b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603802.692776:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19011b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603802.692783:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19011b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603802.692789:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787603802.693063:0:6300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000582454d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6300:1874438355160832:0@lo:104: 00010000:00010000:0.0:1787603802.693088:0:6300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603802.694321:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19011b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603802.694341:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603802.694374:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19011b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603802.694382:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: 00000000c6f3e7a2/0xb5d1f3b1a19011ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19011b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603802.694409:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603802.694412:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603802.694417:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603802.694439:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787603802.694465:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009697e4b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355160960:0@lo:103: 00000100:00100000:1.0:1787603802.694536:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603802.694648:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355160960 00000100:00100000:3.0:1787603802.694660:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355160960 00010000:00010000:3.0:1787603802.694700:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b6da930b/0xb5d1f3b1a19011b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011ad expref: 12 pid: 5816 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603802.694832:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787603802.694877:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c115a17 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+12:3282:x1874438355160960:12345-0@lo:103: 00010000:00010000:2.0:1787603802.694895:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603802.694903:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b6da930b/0xb5d1f3b1a19011b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011ad expref: 12 pid: 5816 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.695033:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b6da930b/0xb5d1f3b1a19011b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011ad expref: 12 pid: 5816 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.695052:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b6da930b/0xb5d1f3b1a19011b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19011ad expref: 12 pid: 5816 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.695068:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.695075:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.695091:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.695097:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.695102:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.695108:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.695113:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000310eeb3c already unused, calling callback (000000006fd7915f) 00010000:00010000:2.0:1787603802.695117:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.695130:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.695151:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603802.695162:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787603802.695420:0:6300:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603802.695429:0:6300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603802.695435:0:6300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000310eeb3c/0xb5d1f3b1a19011f3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603802.696319:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c115a17 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+11:3282:x1874438355160960:12345-0@lo:103: Request processed in 1441us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603802.696331:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787603802.696441:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009697e4b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355160960:0@lo:103: 00010000:00010000:0.0:1787603803.481732:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603804.504392:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603805.531539:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603806.551756:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603807.581555:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787603807.705000:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787603807.705008:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed29010d000 from 1 10000000:01000000:3.0:1787603807.705012:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787603807.705059:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: 00000000077678fd/0xb5d1f3b1a19011fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603807.705073:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: 00000000077678fd/0xb5d1f3b1a19011fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603807.705084:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: 00000000077678fd/0xb5d1f3b1a19011fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603807.705108:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bbc64a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355161088:0@lo:101: 00000100:00100000:3.0:1787603807.705177:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603807.705250:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000257d055a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355161216:0@lo:400: 00000100:00100000:3.0:1787603807.705251:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000081e17d2d going to sleep for 11 seconds 00000100:00100000:2.0:1787603807.705279:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603807.705369:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ba5be367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355161344:0@lo:400: 00000100:00100000:2.0:1787603807.705398:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603807.705438:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355161344 00000100:00100000:2.0:1787603807.705445:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355161344 00000100:00100000:2.0:1787603807.705491:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787603807.705499:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ca7d8ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355161344:12345-0@lo:400: 00000100:00100000:2.0:1787603807.705553:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ca7d8ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355161344:12345-0@lo:400: Request processed in 55us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603807.705560:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787603807.705613:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ba5be367 x1874438355161344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603807.705625:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ba5be367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355161344:0@lo:400: 00000100:00100000:1.0:1787603807.706192:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355161088 00000100:00100000:1.0:1787603807.706200:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355161088 00000100:00100000:1.0:1787603807.706227:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355161216 00000100:00100000:1.0:1787603807.706231:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355161216 00000100:00100000:1.0:1787603807.706244:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787603807.706251:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8a60bff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5818:x1874438355161088:12345-0@lo:101: 00010000:00010000:1.0:1787603807.706261:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603807.706278:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf5a0e16/0xb5d1f3b1a1901201 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19011fa expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603807.706313:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf5a0e16/0xb5d1f3b1a1901201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19011fa expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603807.706322:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf5a0e16/0xb5d1f3b1a1901201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19011fa expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603807.706331:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf5a0e16, rc 0) 00000100:00100000:1.0:1787603807.706368:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8a60bff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355161088:12345-0@lo:101: Request processed in 118us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603807.706374:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787603807.706398:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787603807.706404:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5d0817b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:3282:x1874438355161216:12345-0@lo:400: 00000100:00100000:3.0:1787603807.706592:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bbc64a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355161088:0@lo:101: 00010000:00010000:3.0:1787603807.706606:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: 00000000077678fd/0xb5d1f3b1a19011fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901201 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603807.706614:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: 00000000077678fd/0xb5d1f3b1a19011fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901201 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603807.706671:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bbc64a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355161472:0@lo:501: 00000100:00100000:3.0:1787603807.706700:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603807.706722:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000081e17d2d going to sleep for 11 seconds 00000100:00100000:3.0:1787603807.706734:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355161472 00000100:00100000:3.0:1787603807.706737:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355161472 00000100:00100000:3.0:1787603807.706759:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787603807.706764:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a023c3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355161472:12345-0@lo:501: 00000100:00100000:1.0:1787603807.708465:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5d0817b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:3282:x1874438355161216:12345-0@lo:400: Request processed in 2054us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603807.708480:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787603807.712005:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a023c3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5818:x1874438355161472:12345-0@lo:501: Request processed in 5236us (5300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603807.712021:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787603807.712090:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bbc64a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355161472:0@lo:501: 00000100:00100000:3.0:1787603807.712133:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bbc64a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355161600:0@lo:503: 00000100:00100000:3.0:1787603807.712174:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603807.712216:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000081e17d2d going to sleep for 11 seconds 00000100:00100000:3.0:1787603807.712231:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355161600 00000100:00100000:3.0:1787603807.712238:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355161600 00000100:00100000:3.0:1787603807.712273:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787603807.712281:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088097fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5818:x1874438355161600:12345-0@lo:503: 00000100:00100000:3.0:1787603807.712542:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088097fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5818:x1874438355161600:12345-0@lo:503: Request processed in 261us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603807.712554:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787603807.712588:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bbc64a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355161600:0@lo:503: 00000100:00100000:3.0:1787603807.713349:0:6621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bbc64a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:6621:1874438355161728:0@lo:502: 00000100:00100000:3.0:1787603807.713396:0:6621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603807.713427:0:6621:0:(client.c:2715:ptlrpc_set_wait()) set 000000002c9fe14c going to sleep for 11 seconds 00000100:00100000:2.0:1787603807.713466:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355161728 00000100:00100000:2.0:1787603807.713471:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355161728 00000100:00100000:2.0:1787603807.713509:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787603807.713516:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e6bb027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6621:x1874438355161728:12345-0@lo:502: 00000100:00100000:2.0:1787603807.713710:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e6bb027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6621:x1874438355161728:12345-0@lo:502: Request processed in 194us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603807.713719:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787603807.714250:0:6621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bbc64a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:6621:1874438355161728:0@lo:502: 00000020:01000000:3.0:1787603807.714283:0:6621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787603807.714293:0:6621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603807.714295:0:6621:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787603807.714302:0:6621:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ed29010d000 00000020:00000080:3.0:1787603807.714305:0:6621:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787603807.714346:0:6621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:6621:1874438355161856:0@lo:502: 00000100:00100000:3.0:1787603807.714386:0:6621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603807.714408:0:6621:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed285c1b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603807.714468:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355161856 00000100:00100000:2.0:1787603807.714473:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355161856 00000100:00100000:2.0:1787603807.714508:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787603807.714515:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6621:x1874438355161856:12345-0@lo:502: 00000100:00100000:2.0:1787603807.714737:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6621:x1874438355161856:12345-0@lo:502: Request processed in 221us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603807.714744:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787603807.714817:0:6621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:6621:1874438355161856:0@lo:502: 00000020:01000000:3.0:1787603807.714870:0:6621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603807.714875:0:6621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603807.714876:0:6621:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787603807.714880:0:6621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:0.0:1787603807.715314:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355161216:0@lo:400: 00000020:01000000:0.0:1787603807.715620:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787603807.715641:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787603807.715653:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed281498400/0xb5d1f3b1a19011fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901201 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603807.715665:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed281498400/0xb5d1f3b1a19011fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901201 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603808.604967:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787603809.144703:0:6674:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787603809.144708:0:6674:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787603809.145065:0:6674:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ed286a76000 00000020:01000004:3.0:1787603809.145082:0:6674:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787603809.145093:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787603809.145107:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ed2b50b8000) 00000020:00000080:3.0:1787603809.145123:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787603809.183608:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787603809.184299:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787603809.234677:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787603809.249511:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787603809.249544:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787603809.249601:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787603809.249629:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787603809.250090:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787603809.250101:0:6674:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787603809.250112:0:6674:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb5d1f3b1a190120f 00000020:01000004:2.0:1787603809.250120:0:6674:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787603809.250147:0:6674:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787603809.250151:0:6674:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787603809.250157:0:6674:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787603809.250161:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787603809.250191:0:6674:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ed2b9ee8000) 00000020:00000080:2.0:1787603809.250202:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787603809.251726:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787603809.252200:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787603809.256661:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787603809.264068:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787603809.264084:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787603809.269157:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787603809.269183:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787603809.274148:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787603809.274540:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787603809.274554:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787603809.275496:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787603809.275505:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787603809.296816:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787603809.297369:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787603809.297377:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787603809.300312:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787603809.300328:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787603809.304492:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787603809.304530:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787603809.307556:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787603809.307775:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787603809.307782:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787603809.308824:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787603809.309086:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787603809.385389:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787603809.386353:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787603809.386362:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787603809.394456:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787603809.394470:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787603809.397507:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787603809.397544:0:6674:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787603809.397551:0:6674:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787603809.452544:0:6674:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787603809.452588:0:6674:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.121@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787603809.452593:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787603809.452595:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787603809.452596:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787603809.452598:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787603809.452601:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787603809.452602:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787603809.452604:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787603809.452605:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787603809.452607:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787603809.452608:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787603809.452610:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787603809.452614:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787603809.452616:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787603809.452617:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787603809.452619:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787603809.452620:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787603809.452621:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787603809.452622:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787603809.452623:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787603809.452624:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787603809.452629:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787603809.452630:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787603809.452631:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787603809.452659:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787603809.452687:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355161984:0@lo:253: 00000100:00100000:3.0:1787603809.452756:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603809.452815:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed283e9e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787603809.454033:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355161984 00000100:00100000:1.0:1787603809.454044:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355161984 00000100:00100000:1.0:1787603809.454099:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787603809.454109:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355161984:12345-0@lo:253: 20000000:01000000:1.0:1787603809.454160:0:5816:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787603809.454173:0:5816:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787603809.454178:0:5816:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787603809.454181:0:5816:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787603809.455369:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787603809.455556:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787603809.455570:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787603809.455618:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787603809.455626:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787603809.455655:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787603809.455720:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787603809.458370:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787603809.458404:0:5816:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.121@tcp 20000000:01000000:1.0:1787603809.458406:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.121@tcp (null) (null) (null) 00000040:00080000:1.0:1787603809.458444:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787603809.458452:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787603809.458503:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787603809.458512:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.121@tcp (null) (null) 00000040:00080000:1.0:1787603809.458543:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787603809.458552:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787603809.459019:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787603809.459073:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787603809.462810:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787603809.462876:0:5816:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.121@tcp 20000000:01000000:0.0:1787603809.462879:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.121@tcp (null) (null) (null) 00000040:00080000:0.0:1787603809.463022:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787603809.463031:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787603809.463064:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787603809.463072:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.121@tcp (null) (null) 00000040:00080000:0.0:1787603809.463120:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787603809.463130:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787603809.463161:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787603809.463412:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787603809.463432:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787603809.463435:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787603809.463440:0:5816:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787603809.463454:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787603809.463456:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787603809.463491:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787603809.463494:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787603809.464467:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787603809.465121:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787603809.465163:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787603809.465724:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1787603809.465743:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787603809.465745:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787603809.470674:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787603809.470766:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787603809.470819:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787603809.471185:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1787603809.471241:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1787603809.471275:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1787603809.471289:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787603809.471304:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787603809.479957:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1787603809.480029:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1787603809.480059:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787603809.480569:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787603809.480614:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787603809.481366:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787603809.481391:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787603809.481393:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787603809.481403:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787603809.481427:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.481446:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2813a0a00/0xb5d1f3b1a1901136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190112f expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.481454:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a1901152 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190114b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.481461:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a19011c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19011bb expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.481468:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.481510:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a19011c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19011bb expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.481540:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a19011c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011bb expref: 12 pid: 5813 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603809.481555:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1874438355162112:0@lo:104: 00000100:00100000:3.0:1787603809.481620:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787603809.481726:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a1901152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190114b expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.481732:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a1901152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190114b expref: 12 pid: 5816 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603809.481738:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1874438355162240:0@lo:104: 00000100:00100000:3.0:1787603809.481754:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787603809.481766:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2813a0a00/0xb5d1f3b1a1901136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190112f expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.481771:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2813a0a00/0xb5d1f3b1a1901136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190112f expref: 12 pid: 5813 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603809.481776:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290174000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1874438355162368:0@lo:104: 00000100:00100000:3.0:1787603809.481786:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603809.481792:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2a11680c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603809.482992:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355162112 00000100:00100000:2.0:1787603809.483004:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355162112 00000100:00100000:2.0:1787603809.483044:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355162240 00000100:00100000:2.0:1787603809.483047:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355162240 00000100:00100000:2.0:1787603809.483056:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355162368 00000100:00100000:2.0:1787603809.483058:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355162368 00000100:00100000:2.0:1787603809.483072:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787603809.483081:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290176680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+5:5816:x1874438355162112:12345-0@lo:104: 00010000:00010000:2.0:1787603809.483095:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a19011bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19011c2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.483203:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787603809.483210:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290176680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+5:5816:x1874438355162112:12345-0@lo:104: Request processed in 130us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603809.483217:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787603809.483230:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787603809.483236:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787603809.483237:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a19011bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19011c2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.483245:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed280030c00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603809.483250:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a19011bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19011c2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603809.483251:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290175880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+4:5816:x1874438355162240:12345-0@lo:104: 00010000:00010000:2.0:1787603809.483259:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed281498800/0xb5d1f3b1a190114b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901152 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.483260:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a19011bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19011c2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787603809.483268:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a19011bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19011c2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603809.483274:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787603809.483304:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787603809.483309:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290175880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+4:5816:x1874438355162240:12345-0@lo:104: Request processed in 68us (1554us total) trans 0 rc 0/0 00010000:00010000:0.0:1787603809.483311:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a19011bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19011c2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603809.483317:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787603809.483317:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787603809.483335:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787603809.483337:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a19011bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19011c2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603809.483341:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290177800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+3:5816:x1874438355162368:12345-0@lo:104: 00010000:00010000:0.0:1787603809.483345:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a19011bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19011c2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.483347:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190112f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901136 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.483363:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787603809.483367:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed281498800/0xb5d1f3b1a190114b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901152 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.483379:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed281498800 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603809.483383:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed281498800/0xb5d1f3b1a190114b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1901152 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.483390:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed281498800/0xb5d1f3b1a190114b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1901152 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.483391:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787603809.483395:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290177800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+3:5816:x1874438355162368:12345-0@lo:104: Request processed in 56us (1607us total) trans 0 rc 0/0 10000000:00010000:0.0:1787603809.483399:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed281498800/0xb5d1f3b1a190114b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1901152 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603809.483402:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:0.0:1787603809.483405:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787603809.483416:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787603809.483436:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355162496:0@lo:103: 00000100:00100000:3.0:1787603809.483505:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1874438355162112:0@lo:104: 00000100:00100000:3.0:1787603809.483514:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1874438355162240:0@lo:104: 00000100:00100000:3.0:1787603809.483521:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290174000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1874438355162368:0@lo:104: 00010000:00010000:3.0:1787603809.483542:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.483640:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed281498800/0xb5d1f3b1a190114b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901152 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.483647:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787603809.483672:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed281498800/0xb5d1f3b1a190114b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901152 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.483678:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed281498800/0xb5d1f3b1a190114b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901152 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.483689:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603809.483691:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603809.483693:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603809.483706:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787603809.483716:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355162624:0@lo:103: 00000100:00100000:2.0:1787603809.483725:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603809.483750:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603809.483772:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355162496 00000100:00100000:2.0:1787603809.483777:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355162496 00010000:00010000:2.0:1787603809.483794:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a19011c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011bb expref: 13 pid: 5813 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603809.483826:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355162624 00000100:00100000:2.0:1787603809.483829:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355162624 00010000:00010000:2.0:1787603809.483862:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a1901152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190114b expref: 14 pid: 5816 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603809.483863:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787603809.483871:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:3284:x1874438355162496:12345-0@lo:103: 00000100:00100000:2.0:1787603809.483874:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787603809.483881:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787603809.483887:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787603809.483887:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a19011c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011bb expref: 14 pid: 5813 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.483897:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a19011c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011bb expref: 14 pid: 5813 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603809.483900:0:5807:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787603809.483907:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787603809.483911:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a19011c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19011bb expref: 14 pid: 5813 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603809.483913:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+14:3282:x1874438355162624:12345-0@lo:103: 00010000:00010000:2.0:1787603809.483921:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603809.483925:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a1901152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190114b expref: 13 pid: 5816 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.483925:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787603809.483933:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a1901152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190114b expref: 13 pid: 5816 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.483942:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a1901152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190114b expref: 13 pid: 5816 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.483952:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603809.483954:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:3284:x1874438355162496:12345-0@lo:103: Request processed in 85us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603809.483960:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787603809.483975:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+11:3282:x1874438355162624:12345-0@lo:103: Request processed in 62us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603809.483981:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787603809.484004:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355162624:0@lo:103: 00000100:00100000:3.0:1787603809.484026:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355162496:0@lo:103: 00010000:00010000:0.0:1787603809.484417:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603809.484420:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603809.484421:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603809.484449:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190112f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901136 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.484457:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed281499200 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603809.484460:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190112f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1901136 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.484468:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190112f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1901136 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603809.484475:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190112f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1901136 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603809.484481:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787603809.484510:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190112f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901136 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.484517:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603809.484535:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190112f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901136 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603809.484536:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787603809.484542:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190112f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901136 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603809.484546:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355162752:0@lo:103: 00010000:00010000:3.0:1787603809.484558:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603809.484559:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603809.484561:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603809.484572:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603809.484600:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355162752 00000100:00100000:2.0:1787603809.484604:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355162752 00010000:00010000:2.0:1787603809.484617:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2813a0a00/0xb5d1f3b1a1901136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190112f expref: 11 pid: 5813 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603809.484647:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787603809.484654:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+11:3281:x1874438355162752:12345-0@lo:103: 00010000:00010000:2.0:1787603809.484662:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603809.484674:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2813a0a00/0xb5d1f3b1a1901136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190112f expref: 11 pid: 5813 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.484684:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2813a0a00/0xb5d1f3b1a1901136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190112f expref: 11 pid: 5813 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.484694:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2813a0a00/0xb5d1f3b1a1901136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190112f expref: 11 pid: 5813 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.484706:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.484714:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.484726:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.484732:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.484738:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.484744:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.484749:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed281499600 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787603809.484752:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.484759:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.484784:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.484793:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603809.484826:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+10:3281:x1874438355162752:12345-0@lo:103: Request processed in 172us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603809.484832:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787603809.484926:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355162752:0@lo:103: 00010000:00010000:3.0:1787603809.485007:0:5816:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.485020:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.485027:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a190121d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787603809.485039:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787603809.568417:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+9:6674:x1874438355161984:12345-0@lo:253: Request processed in 114300us (115651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603809.568432:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787603809.568537:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355161984:0@lo:253: 10000000:01000000:1.0:1787603809.568556:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787603809.568559:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787603809.568561:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787603809.568562:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787603809.568563:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787603809.568565:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787603809.568566:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787603809.568567:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787603809.568569:0:6674:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787603809.568571:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787603809.568572:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787603809.568592:0:6674:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ed286a76000 from lustre-OST0000 10000000:01000000:1.0:1787603809.568616:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787603809.568619:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787603809.568627:0:6674:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ed28654cd28 local copy 10000000:01000000:1.0:1787603809.568646:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787603809.568689:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.568701:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.568712:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603809.568733:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355162880:0@lo:101: 00000100:00100000:1.0:1787603809.568769:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603809.568825:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed285c1b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787603809.568910:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355162880 00000100:00100000:2.0:1787603809.568917:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355162880 00000100:00100000:2.0:1787603809.568954:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787603809.568962:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+9:6674:x1874438355162880:12345-0@lo:101: 00010000:00010000:2.0:1787603809.568974:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603809.568986:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a190122b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901224 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.569008:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a190122b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901224 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.569019:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a190122b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901224 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.569028:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217da00, rc 0) 00000100:00100000:2.0:1787603809.569067:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+10:6674:x1874438355162880:12345-0@lo:101: Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603809.569072:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787603809.569222:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355162880:0@lo:101: 00010000:00010000:1.0:1787603809.569236:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb5d1f3b1a190122b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.569244:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb5d1f3b1a190122b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603809.569326:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163008:0@lo:501: 00000100:00100000:1.0:1787603809.569351:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603809.569376:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed285c1b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787603809.569435:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355163008 00000100:00100000:0.0:1787603809.569440:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355163008 00000100:00100000:0.0:1787603809.569475:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787603809.569482:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+10:6674:x1874438355163008:12345-0@lo:501: 00000100:00100000:0.0:1787603809.569672:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+10:6674:x1874438355163008:12345-0@lo:501: Request processed in 190us (320us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787603809.569680:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787603809.569759:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163008:0@lo:501: 10000000:01000000:1.0:1787603809.569770:0:6674:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787603809.569793:0:6674:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787603809.569797:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb5d1f3b1a190122b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.569815:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb5d1f3b1a190122b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.569821:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb5d1f3b1a190122b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.569862:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787603809.569879:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ed286a76000 10000000:01000000:1.0:1787603809.569884:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787603809.569888:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ed28654cd28 10000000:01000000:1.0:1787603809.569891:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787603809.569906:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ed28654cd28 from 1 10000000:01000000:1.0:1787603809.569909:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787603809.569925:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1e00/0xb5d1f3b1a1901232 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.569932:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1e00/0xb5d1f3b1a1901232 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.569940:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1e00/0xb5d1f3b1a1901232 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603809.569953:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163136:0@lo:101: 00000100:00100000:1.0:1787603809.569978:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603809.569996:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed283e9e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787603809.570010:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355163136 00000100:00100000:1.0:1787603809.570014:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355163136 00000100:00100000:1.0:1787603809.570032:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787603809.570037:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+10:6674:x1874438355163136:12345-0@lo:101: 00010000:00010000:1.0:1787603809.570050:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603809.570059:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2813a1600/0xb5d1f3b1a1901239 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901232 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.570073:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2813a1600/0xb5d1f3b1a1901239 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901232 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.570082:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2813a1600/0xb5d1f3b1a1901239 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901232 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.570089:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2813a1600, rc 0) 00000100:00100000:1.0:1787603809.570117:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+11:6674:x1874438355163136:12345-0@lo:101: Request processed in 79us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603809.570122:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787603809.570151:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163136:0@lo:101: 00010000:00010000:1.0:1787603809.570162:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1e00/0xb5d1f3b1a1901232 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901239 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.570179:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1e00/0xb5d1f3b1a1901232 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901239 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603809.570191:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787603809.570198:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1e00/0xb5d1f3b1a1901232 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901239 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.570205:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1e00/0xb5d1f3b1a1901232 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901239 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603809.570212:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787603809.570221:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787603809.570224:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787603809.570226:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787603809.570239:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.570245:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.570252:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603809.570262:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163264:0@lo:101: 00000100:00100000:1.0:1787603809.570285:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603809.570298:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed283e9e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787603809.570310:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355163264 00000100:00100000:1.0:1787603809.570314:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355163264 00000100:00100000:1.0:1787603809.570331:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787603809.570336:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+11:6674:x1874438355163264:12345-0@lo:101: 00010000:00010000:1.0:1787603809.570343:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603809.570350:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2813a1800/0xb5d1f3b1a1901247 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901240 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.570362:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2813a1800/0xb5d1f3b1a1901247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901240 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.570370:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2813a1800/0xb5d1f3b1a1901247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901240 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.570376:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2813a1800, rc 0) 00000100:00100000:1.0:1787603809.570409:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355163264:12345-0@lo:101: Request processed in 73us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603809.570415:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787603809.570442:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163264:0@lo:101: 00010000:00010000:1.0:1787603809.570452:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901247 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.570459:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901247 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603809.570512:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163392:0@lo:501: 00000100:00100000:1.0:1787603809.570535:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603809.570549:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed283e9e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787603809.570561:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355163392 00000100:00100000:1.0:1787603809.570564:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355163392 00000100:00100000:1.0:1787603809.570580:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787603809.570586:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355163392:12345-0@lo:501: 00000100:00100000:1.0:1787603809.570746:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355163392:12345-0@lo:501: Request processed in 159us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603809.570753:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787603809.570782:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163392:0@lo:501: 00000100:00100000:1.0:1787603809.570807:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163520:0@lo:503: 00000100:00100000:1.0:1787603809.570870:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603809.570889:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed283e9e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787603809.570900:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355163520 00000100:00100000:1.0:1787603809.570904:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355163520 00000100:00100000:1.0:1787603809.570920:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787603809.570934:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355163520:12345-0@lo:503: 00000100:00100000:1.0:1787603809.571057:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355163520:12345-0@lo:503: Request processed in 124us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603809.571064:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787603809.571093:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163520:0@lo:503: 00000040:00080000:1.0:1787603809.571394:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787603809.571466:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163648:0@lo:502: 00000100:00100000:1.0:1787603809.571499:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603809.571525:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed283e9e480 going to sleep for 11 seconds 00000100:00100000:2.0:1787603809.571757:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355163648 00000100:00100000:2.0:1787603809.571762:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355163648 00000100:00100000:2.0:1787603809.571801:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787603809.571808:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355163648:12345-0@lo:502: 00000100:00100000:2.0:1787603809.572081:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355163648:12345-0@lo:502: Request processed in 273us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603809.572087:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1787603809.572185:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787603809.572193:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb5d1f3b1a190122b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.572201:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2813a0e00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603809.572212:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb5d1f3b1a190122b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.572221:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb5d1f3b1a190122b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787603809.572227:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb5d1f3b1a190122b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603809.572233:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787603809.572255:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb5d1f3b1a190122b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.572261:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787603809.572287:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb5d1f3b1a190122b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.572294:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901224 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb5d1f3b1a190122b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.572308:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603809.572310:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603809.572311:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603809.572363:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787603809.572375:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355163776:0@lo:103: 00000100:00100000:3.0:1787603809.572406:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603809.572518:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355163776 00000100:00100000:0.0:1787603809.572523:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355163776 00000100:00100000:0.0:1787603809.572561:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787603809.572568:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290175180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:3284:x1874438355163776:12345-0@lo:103: 00010000:00010000:0.0:1787603809.572578:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603809.572593:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a190122b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a1901224 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.572615:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603809.572653:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290175180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+11:3284:x1874438355163776:12345-0@lo:103: Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603809.572659:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787603809.572757:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355163776:0@lo:103: 00000100:00100000:1.0:1787603809.572875:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163648:0@lo:502: 00000040:00080000:0.0:1787603809.573337:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787603809.573387:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787603809.573419:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787603809.573466:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787603809.573501:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787603809.573534:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787603809.573561:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163904:0@lo:502: 00000100:00100000:0.0:1787603809.573609:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603809.573689:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28393a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787603809.573727:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355163904 00000100:00100000:3.0:1787603809.573733:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355163904 00000100:00100000:3.0:1787603809.573872:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787603809.573881:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+11:6674:x1874438355163904:12345-0@lo:502: 00000100:00100000:3.0:1787603809.574049:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+11:6674:x1874438355163904:12345-0@lo:502: Request processed in 170us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603809.574057:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787603809.574151:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355163904:0@lo:502: 00000040:00080000:0.0:1787603809.574254:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787603809.574264:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787603809.582716:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787603809.582730:0:6695:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787603809.582738:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787603809.582740:0:6695:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787603809.582746:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787603809.582761:0:6695:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ed2952f8000) 00000020:00000080:0.0:1787603809.582786:0:6695:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787603809.582792:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787603809.582923:0:6695:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ed286a76000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787603809.582931:0:6695:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787603809.582939:0:6695:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb5d1f3b1a1901255 00010000:00010000:0.0:1787603809.587276:0:6695:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787603809.587685:0:6695:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787603809.595565:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787603809.595925:0:6695:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787603809.611254:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787603809.611998:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787603809.613677:0:6695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787603809.613689:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787603809.613695:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787603809.613697:0:6695:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787603809.613701:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787603809.613705:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787603809.613707:0:6695:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787603809.613710:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787603809.613712:0:6695:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787603809.613759:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787603809.613762:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787603809.613764:0:6695:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787603809.613766:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787603809.614063:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787603809.614088:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787603809.614113:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901247 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.614126:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901247 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603809.614135:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed286a76000 from 1 10000000:01000000:0.0:1787603809.614138:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787603809.614185:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.614194:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.614206:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603809.614230:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164032:0@lo:101: 00000100:00100000:0.0:1787603809.614298:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603809.614353:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa668300 going to sleep for 11 seconds 00000100:00100000:3.0:1787603809.614407:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355164032 00000100:00100000:3.0:1787603809.614415:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355164032 00000100:00100000:3.0:1787603809.614462:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787603809.614472:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+11:6674:x1874438355164032:12345-0@lo:101: 00010000:00010000:3.0:1787603809.614485:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603809.614496:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a1901263 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190125c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.614520:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a1901263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190125c expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.614546:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a1901263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190125c expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.614555:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed281499600, rc 0) 00000100:00100000:3.0:1787603809.614591:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355164032:12345-0@lo:101: Request processed in 121us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603809.614598:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787603809.615876:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164032:0@lo:101: 00010000:00010000:0.0:1787603809.616032:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901263 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.616044:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901263 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603809.616235:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164160:0@lo:501: 00000100:00100000:3.0:1787603809.616283:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603809.616321:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2a1168900 going to sleep for 11 seconds 00000100:00100000:0.0:1787603809.616417:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355164160 00000100:00100000:0.0:1787603809.616423:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355164160 00000100:00100000:0.0:1787603809.616464:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787603809.616474:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355164160:12345-0@lo:501: 00000100:00100000:0.0:1787603809.616796:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355164160:12345-0@lo:501: Request processed in 322us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603809.616803:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787603809.622047:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164160:0@lo:501: 00000100:00100000:3.0:1787603809.623565:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164288:0@lo:503: 00000100:00100000:3.0:1787603809.623655:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603809.623700:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2984fd240 going to sleep for 11 seconds 00000100:00100000:2.0:1787603809.624361:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355164288 00000100:00100000:2.0:1787603809.624371:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355164288 00000100:00100000:2.0:1787603809.624429:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787603809.624441:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355164288:12345-0@lo:503: 00000100:00100000:2.0:1787603809.624673:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355164288:12345-0@lo:503: Request processed in 234us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603809.624681:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787603809.625241:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164288:0@lo:503: 00000040:00080000:3.0:1787603809.625527:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787603809.625616:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164416:0@lo:502: 00000100:00100000:3.0:1787603809.625664:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603809.625694:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2984fd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787603809.625818:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355164416 00000100:00100000:1.0:1787603809.625824:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355164416 00000100:00100000:1.0:1787603809.625879:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787603809.625888:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355164416:12345-0@lo:502: 00000100:00100000:1.0:1787603809.626069:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355164416:12345-0@lo:502: Request processed in 182us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603809.626077:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787603809.626338:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164416:0@lo:502: 00000040:00080000:3.0:1787603809.626572:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787603809.626622:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787603809.626649:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164544:0@lo:502: 00000100:00100000:3.0:1787603809.626689:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603809.626722:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2984fd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787603809.626796:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355164544 00000100:00100000:1.0:1787603809.626800:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355164544 00000100:00100000:1.0:1787603809.626832:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787603809.626868:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355164544:12345-0@lo:502: 00000100:00100000:1.0:1787603809.627122:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355164544:12345-0@lo:502: Request processed in 254us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603809.627128:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787603809.627213:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164544:0@lo:502: 00000040:00080000:3.0:1787603809.627295:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787603809.627306:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00010000:00010000:0.0:1787603809.628548:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787603809.630409:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787603809.630426:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603809.633784:0:6699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787603809.634101:0:6699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ed286a76000 00000020:00000080:3.0:1787603809.634107:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787603809.634186:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603809.634190:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603809.634192:0:6699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787603809.634195:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787603809.636943:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787603809.636982:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787603809.637098:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901263 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603809.637110:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901263 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787603809.637239:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787603809.637243:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ed286a76000 10000000:01000000:2.0:1787603809.637247:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ed286a76000 10000000:01000000:2.0:1787603809.637251:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787603809.637258:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ed286a76000 from 1 10000000:01000000:2.0:1787603809.637261:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787603809.637304:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.637312:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.637324:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603809.637361:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164672:0@lo:101: 00000100:00100000:2.0:1787603809.637426:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603809.637476:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed29853ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787603809.637528:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355164672 00000100:00100000:3.0:1787603809.637535:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355164672 00000100:00100000:3.0:1787603809.637601:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787603809.637608:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355164672:12345-0@lo:101: 00010000:00010000:3.0:1787603809.637618:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603809.637628:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed281499200/0xb5d1f3b1a1901271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190126a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.637645:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed281499200/0xb5d1f3b1a1901271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190126a expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.637651:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed281499200/0xb5d1f3b1a1901271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190126a expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.637657:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed281499200, rc 0) 00000100:00100000:3.0:1787603809.637705:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6674:x1874438355164672:12345-0@lo:101: Request processed in 96us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603809.637712:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787603809.637732:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164672:0@lo:101: 00010000:00010000:0.0:1787603809.637746:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901271 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.637754:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901271 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603809.638128:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164800:0@lo:501: 00000100:00100000:1.0:1787603809.638157:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603809.642437:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787603809.646049:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355164800 00000100:00100000:2.0:1787603809.646063:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355164800 00000100:00100000:2.0:1787603809.646128:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787603809.646139:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6674:x1874438355164800:12345-0@lo:501: 00000100:00100000:2.0:1787603809.647883:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6674:x1874438355164800:12345-0@lo:501: Request processed in 1739us (9718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603809.647905:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787603809.648249:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164800:0@lo:501: 00000100:00100000:1.0:1787603809.648303:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164928:0@lo:503: 00000100:00100000:1.0:1787603809.648354:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603809.648397:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787603809.649116:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355164928 00000100:00100000:2.0:1787603809.649125:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355164928 00000100:00100000:2.0:1787603809.649173:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787603809.649183:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6674:x1874438355164928:12345-0@lo:503: 00000100:00100000:2.0:1787603809.649381:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6674:x1874438355164928:12345-0@lo:503: Request processed in 199us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603809.649389:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787603809.649464:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355164928:0@lo:503: 00000040:00080000:1.0:1787603809.649751:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787603809.649814:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355165056:0@lo:502: 00000100:00100000:1.0:1787603809.649900:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603809.649920:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787603809.650618:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355165056 00000100:00100000:2.0:1787603809.650625:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355165056 00000100:00100000:2.0:1787603809.650654:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787603809.650663:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6674:x1874438355165056:12345-0@lo:502: 00000100:00100000:2.0:1787603809.650874:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6674:x1874438355165056:12345-0@lo:502: Request processed in 211us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603809.650882:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787603809.651106:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355165056:0@lo:502: 00000040:00080000:1.0:1787603809.651612:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787603809.652120:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787603809.652173:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787603809.652383:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787603809.652425:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787603809.652787:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787603809.652825:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787603809.652893:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787603809.652943:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787603809.652979:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787603809.653561:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787603809.653620:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787603809.653657:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787603809.654143:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787603809.654198:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787603809.654357:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787603809.654384:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787603809.654422:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787603809.654631:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787603809.654659:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787603809.654711:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787603809.654739:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787603809.654764:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787603809.654799:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787603809.654865:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787603809.654896:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787603809.654941:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787603809.654976:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787603809.655038:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355165184:0@lo:502: 00000100:00100000:1.0:1787603809.655115:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603809.655177:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787603809.656174:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355165184 00000100:00100000:2.0:1787603809.656184:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355165184 00000100:00100000:2.0:1787603809.656247:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787603809.656258:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6674:x1874438355165184:12345-0@lo:502: 00000100:00100000:2.0:1787603809.656504:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6674:x1874438355165184:12345-0@lo:502: Request processed in 248us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603809.656511:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787603809.656580:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355165184:0@lo:502: 00000040:00080000:1.0:1787603809.656680:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787603809.656693:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787603809.657378:0:6700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787603809.657404:0:6700:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ed2bf083370) 00000020:00000080:1.0:1787603809.657423:0:6700:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787603809.657505:0:6700:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ed286a76000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787603809.657508:0:6700:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ed286a76000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787603809.657511:0:6700:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ed286a76000 3 00010000:00080000:1.0:1787603809.657535:0:6700:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ed2b6f7a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.121@tcp at head 00010000:00010000:1.0:1787603809.661081:0:6700:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787603809.661368:0:6700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787603809.661406:0:6700:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787603809.661419:0:6700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb5d1f3b1a190127f 00000100:00080000:1.0:1787603809.661523:0:6700:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787603809.661530:0:6700:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ed2b6f7a800 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:1.0:1787603809.661564:0:6700:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2b606e680 x1874438355165312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787603809.661594:0:6700:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787603809.661702:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787603809.661724:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355165440:0@lo:400: 00000100:00100000:3.0:1787603809.661790:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603809.661868:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355165440 00000100:00100000:3.0:1787603809.661875:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355165440 00000100:00100000:3.0:1787603809.661926:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787603809.661937:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355165440:12345-0@lo:400: 00000100:00100000:3.0:1787603809.661987:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355165440:12345-0@lo:400: Request processed in 51us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603809.661994:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787603809.662134:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed290176a00 x1874438355165440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603809.662148:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355165440:0@lo:400: 00000040:00080000:3.0:1787603809.662292:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1787603809.662541:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874438355165312:0@lo:38: 00000100:00100000:2.0:1787603809.662590:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787603809.662634:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787603809.662656:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787603809.662675:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901271 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603809.662685:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901271 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787603809.662729:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787603809.662731:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787603809.662733:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787603809.662734:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787603809.662735:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787603809.662736:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787603809.662738:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787603809.662739:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787603809.662741:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787603809.662742:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787603809.662743:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787603809.662747:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787603809.662749:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787603809.662750:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787603809.662751:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787603809.662752:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787603809.662753:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787603809.662754:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787603809.662759:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787603809.662760:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787603809.662761:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787603809.662762:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787603809.662763:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787603809.662779:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787603809.662789:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355165568:0@lo:253: 00000100:00100000:2.0:1787603809.662824:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603809.662856:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed29853ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787603809.663052:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355165312 00000100:00100000:3.0:1787603809.663058:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355165312 00000100:00100000:3.0:1787603809.663080:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787603809.663087:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3280:x1874438355165312:12345-0@lo:38: 00000100:00100000:1.0:1787603809.663089:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355165568 00000100:00100000:1.0:1787603809.663092:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355165568 00010000:00080000:3.0:1787603809.663105:0:5822:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000100:00100000:1.0:1787603809.663116:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787603809.663128:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6674:x1874438355165568:12345-0@lo:253: 00000020:00000080:3.0:1787603809.663131:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb5d1f3b1a1901286 20000000:01000000:1.0:1787603809.663145:0:5816:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000004:00100000:3.0:1787603809.663146:0:5822:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 20000000:01000000:1.0:1787603809.663157:0:5816:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1787603809.663184:0:5822:0:(import.c:65:import_set_state_nolock()) ffff9ed2bf07a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787603809.663229:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874438355165312:12345-0@lo:38: Request processed in 140us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603809.663235:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787603809.663266:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2b606e680 x1874438355165312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787603819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603809.663290:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787603809.663303:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787603809.663474:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787603809.663480:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787603809.663483:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2b6f7a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787603809.663490:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874438355165312:0@lo:38: 20000000:01000000:2.0:1787603809.722576:0:5816:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787603809.722596:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787603809.722709:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787603809.722715:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787603809.722739:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.722761:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19011e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19011de expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.722769:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.722811:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19011e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19011de expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.723027:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19011e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011de expref: 13 pid: 5816 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603809.723045:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1874438355165696:0@lo:104: 00000100:00100000:0.0:1787603809.723118:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603809.723188:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa668540 going to sleep for 11 seconds 00000100:00100000:3.0:1787603809.723258:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355165696 00000100:00100000:3.0:1787603809.723267:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355165696 00000100:00100000:3.0:1787603809.723321:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787603809.723330:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+3:5838:x1874438355165696:12345-0@lo:104: 00010000:00010000:3.0:1787603809.723342:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a19011de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19011e5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723392:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787603809.723397:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+3:5838:x1874438355165696:12345-0@lo:104: Request processed in 69us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603809.723403:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787603809.723423:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603809.723429:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a19011de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19011e5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723438:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed280031200 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603809.723442:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a19011de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19011e5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723450:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a19011de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19011e5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603809.723457:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a19011de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19011e5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603809.723469:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787603809.723493:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a19011de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19011e5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723499:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603809.723514:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a19011de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19011e5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723521:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a19011de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19011e5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723536:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603809.723538:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603809.723539:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603809.723547:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787603809.723556:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355165824:0@lo:103: 00000100:00100000:3.0:1787603809.723588:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603809.723614:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355165824 00000100:00100000:3.0:1787603809.723618:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355165824 00010000:00010000:3.0:1787603809.723633:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19011e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011de expref: 14 pid: 5816 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603809.723655:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787603809.723662:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa48f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+14:3282:x1874438355165824:12345-0@lo:103: 00010000:00010000:3.0:1787603809.723671:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603809.723676:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19011e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011de expref: 14 pid: 5816 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723686:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19011e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011de expref: 14 pid: 5816 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723709:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723716:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787603809.723729:0:5807:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003196166s 00010000:00010000:3.0:1787603809.723733:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723740:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723746:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723752:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723758:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed280031400 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787603809.723762:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723771:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723778:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603809.723834:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603809.723911:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa48f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+14:3282:x1874438355165824:12345-0@lo:103: Request processed in 250us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603809.723922:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787603809.723983:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355165824:0@lo:103: 00010000:00010000:0.0:1787603809.724275:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19011e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19011de expref: 13 pid: 5816 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603809.724287:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1874438355165696:0@lo:104: 00010000:00010000:0.0:1787603809.724307:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.724318:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.724325:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603809.724331:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed280031400/0xb5d1f3b1a190128d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603809.733683:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:6674:x1874438355165568:12345-0@lo:253: Request processed in 70545us (70847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603809.733698:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787603809.733793:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:6674:1874438355165568:0@lo:253: 10000000:01000000:2.0:1787603809.733811:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787603809.733815:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787603809.733816:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787603809.733818:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787603809.733819:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787603809.733820:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787603809.733821:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787603809.733822:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787603809.733824:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787603809.733825:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787603809.733827:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787603809.733828:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787603809.734114:0:6674:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787603809.741378:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787603809.741548:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787603809.741823:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787603809.742307:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787603809.742531:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787603809.743046:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787603809.744420:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787603810.026603:0:6674:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787603810.026611:0:6674:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787603810.026646:0:6674:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787603810.026705:0:6674:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787603810.026720:0:6674:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787603810.026746:0:6674:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787603810.664785:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603811.673578:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603812.695965:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787603813.724423:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787603813.724448:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ed29010d000 from 21 10000000:01000000:0.0:1787603813.724455:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787603813.724521:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603813.724534:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603813.724548:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603813.724579:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355165952:0@lo:101: 00000100:00100000:0.0:1787603813.724672:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603813.724737:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b5c7f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787603813.724766:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355165952 00000100:00100000:0.0:1787603813.724776:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355165952 00000100:00100000:0.0:1787603813.724864:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787603813.724876:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5818:x1874438355165952:12345-0@lo:101: 00010000:00010000:0.0:1787603813.724891:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603813.724906:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed280030800/0xb5d1f3b1a190129b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901294 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603813.724937:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed280030800/0xb5d1f3b1a190129b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901294 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603813.724948:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed280030800/0xb5d1f3b1a190129b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901294 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603813.724959:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed280030800, rc 0) 00000100:00100000:0.0:1787603813.725004:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355165952:12345-0@lo:101: Request processed in 130us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603813.725019:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787603813.725084:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355165952:0@lo:101: 00010000:00010000:0.0:1787603813.725101:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190129b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603813.725111:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190129b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603813.725187:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355166080:0@lo:501: 00000100:00100000:0.0:1787603813.725215:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603813.725234:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b5c7f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787603813.725288:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355166080 00000100:00100000:0.0:1787603813.725292:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355166080 00000100:00100000:0.0:1787603813.725317:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787603813.725324:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355166080:12345-0@lo:501: 00000100:00100000:0.0:1787603813.725778:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355166080:12345-0@lo:501: Request processed in 452us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603813.725788:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1787603813.729648:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603813.747736:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355166080:0@lo:501: 00000100:00100000:3.0:1787603813.747852:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355166208:0@lo:503: 00000100:00100000:3.0:1787603813.747963:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603813.748035:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed181249a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787603813.748067:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355166208 00000100:00100000:3.0:1787603813.748076:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355166208 00000100:00100000:3.0:1787603813.748152:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787603813.748164:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355166208:12345-0@lo:503: 00000100:00100000:3.0:1787603813.751921:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355166208:12345-0@lo:503: Request processed in 3742us (3941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603813.751941:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787603813.754057:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355166208:0@lo:503: 00000100:00100000:1.0:1787603813.761418:0:6864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:6864:1874438355166336:0@lo:502: 00000100:00100000:1.0:1787603813.761543:0:6864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603813.761614:0:6864:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295245240 going to sleep for 11 seconds 00000100:00100000:0.0:1787603813.764831:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355166336 00000100:00100000:0.0:1787603813.766053:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355166336 00000100:00100000:0.0:1787603813.767017:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787603813.767037:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6864:x1874438355166336:12345-0@lo:502: 00000100:00100000:0.0:1787603813.773652:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6864:x1874438355166336:12345-0@lo:502: Request processed in 6605us (12091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603813.773677:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787603813.778315:0:6864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:6864:1874438355166336:0@lo:502: 00000100:00100000:3.0:1787603813.778493:0:6864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:6864:1874438355166464:0@lo:502: 00000100:00100000:3.0:1787603813.778603:0:6864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603813.778670:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355166464 00000100:00100000:3.0:1787603813.778680:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355166464 00000100:00100000:3.0:1787603813.778744:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787603813.778755:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6864:x1874438355166464:12345-0@lo:502: 00000100:00100000:3.0:1787603813.784320:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:6864:x1874438355166464:12345-0@lo:502: Request processed in 5555us (5706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603813.784341:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787603813.784504:0:6864:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed181249900 going to sleep for 11 seconds 00000100:00100000:3.0:1787603813.784545:0:6864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:6864:1874438355166464:0@lo:502: 00000040:00080000:3.0:1787603813.784606:0:6864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787603813.785582:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787603813.785616:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787603813.785631:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190129b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603813.785645:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190129b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603813.785656:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787603813.785659:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ed29010d000 from 4 10000000:01000000:1.0:1787603813.785662:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787603813.785719:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603813.785728:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603813.785739:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603813.785762:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355166592:0@lo:101: 00000100:00100000:1.0:1787603813.788387:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603813.788477:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295245180 going to sleep for 11 seconds 00000100:00100000:3.0:1787603813.788556:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355166592 00000100:00100000:3.0:1787603813.788568:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355166592 00000100:00100000:3.0:1787603813.788639:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787603813.788652:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355166592:12345-0@lo:101: 00010000:00010000:3.0:1787603813.788674:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603813.788701:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19012a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19012a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.788737:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19012a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19012a2 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.788750:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19012a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19012a2 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.788761:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed281499000, rc 0) 00000100:00100000:3.0:1787603813.789154:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355166592:12345-0@lo:101: Request processed in 188us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603813.789162:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787603813.790998:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355166592:0@lo:101: 00010000:00010000:3.0:1787603813.791041:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19012a9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.791054:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19012a9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603813.791432:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355166720:0@lo:256: 00000100:00100000:3.0:1787603813.791522:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603813.791578:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed181249f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787603813.793374:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355166720 00000100:00100000:1.0:1787603813.793394:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355166720 00000100:00100000:1.0:1787603813.793461:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787603813.793475:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355166720:12345-0@lo:256: 20000000:01000000:1.0:1787603813.793507:0:5813:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787603813.793530:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787603813.793535:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787603813.793691:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355166720:12345-0@lo:256: Request processed in 218us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603813.793700:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787603813.794396:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355166720:0@lo:256: 10000000:01000000:3.0:1787603813.794475:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787603813.794490:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19012a9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.794503:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19012a9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603813.794514:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787603813.794518:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787603813.794521:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787603813.794562:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.794571:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.794581:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603813.794618:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355166848:0@lo:101: 00000100:00100000:3.0:1787603813.794676:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603813.794719:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed181249f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787603813.794740:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355166848 00000100:00100000:3.0:1787603813.794746:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355166848 00000100:00100000:3.0:1787603813.794788:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787603813.794797:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355166848:12345-0@lo:101: 00010000:00010000:3.0:1787603813.794810:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603813.794826:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a19012b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19012b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.797009:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a19012b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19012b0 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.797035:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a19012b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19012b0 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.797048:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed281498800, rc 0) 00000100:00100000:3.0:1787603813.797177:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355166848:12345-0@lo:101: Request processed in 2379us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603813.797188:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787603813.798431:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355166848:0@lo:101: 00010000:00010000:3.0:1787603813.798467:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19012b7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.798480:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19012b7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603813.798597:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355166976:0@lo:501: 00000100:00100000:3.0:1787603813.798662:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603813.798712:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed181249f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787603813.800389:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355166976 00000100:00100000:1.0:1787603813.800408:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355166976 00000100:00100000:1.0:1787603813.800485:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787603813.800497:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355166976:12345-0@lo:501: 00000100:00100000:1.0:1787603813.801089:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355166976:12345-0@lo:501: Request processed in 591us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603813.801097:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787603813.807122:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355166976:0@lo:501: 00000100:00100000:3.0:1787603813.807352:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355167104:0@lo:503: 00000100:00100000:3.0:1787603813.807473:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603813.807583:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed181249f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787603813.809028:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355167104 00000100:00100000:1.0:1787603813.809044:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355167104 00000100:00100000:0.0:1787603813.815524:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787603813.815538:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355167104:12345-0@lo:503: 00000100:00100000:0.0:1787603813.817171:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355167104:12345-0@lo:503: Request processed in 1623us (9687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603813.817188:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787603813.817670:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355167104:0@lo:503: 00000100:00100000:3.0:1787603813.818116:0:6865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:6865:1874438355167232:0@lo:502: 00000100:00100000:3.0:1787603813.818198:0:6865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603813.818400:0:6865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed181249300 going to sleep for 11 seconds 00000100:00100000:0.0:1787603813.819694:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355167232 00000100:00100000:0.0:1787603813.819708:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355167232 00000100:00100000:1.0:1787603813.819790:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787603813.819805:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+15:6865:x1874438355167232:12345-0@lo:502: 00000100:00100000:1.0:1787603813.822614:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+15:6865:x1874438355167232:12345-0@lo:502: Request processed in 2798us (4401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603813.822636:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787603813.822950:0:6865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:6865:1874438355167232:0@lo:502: 00000020:01000000:3.0:1787603813.823001:0:6865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787603813.823012:0:6865:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787603813.823020:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603813.823023:0:6865:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787603813.823031:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787603813.823036:0:6865:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.121@tcp to nid 0x20000c0a8ca79 (192.168.202.121@tcp) 00000020:01000000:3.0:1787603813.823065:0:6865:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787603813.823069:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787603813.823089:0:6865:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ed2b50b99b8) 00000020:00000080:3.0:1787603813.823116:0:6865:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787603813.823123:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787603813.823260:0:6865:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787603813.823267:0:6865:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787603813.823293:0:6865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a19012c5 00010000:00080000:3.0:1787603813.823339:0:6865:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ed2870d3000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.121@tcp at head 00010000:00010000:3.0:1787603813.823632:0:6865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787603813.939905:0:6865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787603813.939937:0:6865:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787603813.940639:0:6865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787603813.940877:0:6865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787603813.940937:0:6865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787603813.941014:0:6865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787603813.943421:0:6871:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787603813.943430:0:6871:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787603813.945102:0:6865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787603813.945123:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787603813.945183:0:6865:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787603813.945217:0:6865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb5d1f3b1a19012cc 00000100:00080000:3.0:1787603813.945333:0:6865:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787603813.945342:0:6865:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ed2870d3000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:3.0:1787603813.945392:0:6865:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed290175180 x1874438355167360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787603813.945421:0:6865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1787603813.945551:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355167360:0@lo:8: 00000100:00100000:2.0:1787603813.945650:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603813.945755:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355167360 00000100:00100000:2.0:1787603813.945764:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355167360 00000100:00100000:2.0:1787603813.945804:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787603813.945813:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874438355167360:12345-0@lo:8: 00010000:00080000:2.0:1787603813.945877:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:2.0:1787603813.945915:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb5d1f3b1a19012d3 00002000:00100000:2.0:1787603813.945958:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ed2ba019800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787603813.945963:0:6676:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787603813.945968:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:3.0:1787603813.946223:0:6865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00002000:00100000:2.0:1787603813.946302:0:6676:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000080:3.0:1787603813.946303:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603813.946308:0:6865:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787603813.946316:0:6865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787603813.946322:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603813.946323:0:6865:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787603813.946327:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787603813.946330:0:6865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787603813.946369:0:6865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290177480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:6865:1874438355167488:0@lo:502: 00000100:00100000:3.0:1787603813.946460:0:6865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603813.946509:0:6865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2984fd000 going to sleep for 11 seconds 00000100:00100000:3.0:1787603813.946542:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355167488 00000100:00100000:3.0:1787603813.946548:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355167488 00002000:00080000:2.0:1787603813.946552:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1787603813.946605:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1787603813.946610:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9ed2ba01a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787603813.946620:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+15:6865:x1874438355167488:12345-0@lo:502: 00000100:00100000:2.0:1787603813.946741:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1874438355167360:12345-0@lo:8: Request processed in 920us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603813.946754:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787603813.946953:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+15:6865:x1874438355167488:12345-0@lo:502: Request processed in 336us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603813.946973:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1787603813.947122:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed290175180 x1874438355167360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787603823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603813.947146:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787603813.947156:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787603813.947166:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787603813.947172:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787603813.947174:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2870d3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787603813.947186:0:3280:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787603813.947196:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355167360:0@lo:8: 00000004:00080000:2.0:1787603813.947235:0:6871:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787603813.947299:0:6865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290177480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:6865:1874438355167488:0@lo:502: 00000020:01000000:3.0:1787603813.947344:0:6865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603813.947350:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603813.947352:0:6865:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787603813.947358:0:6865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000004:00080000:2.0:1787603813.947363:0:6871:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 147011523991ns, next at 0ns, rc = 0 00000020:01000000:3.0:1787603813.947549:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787603813.947576:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787603813.947588:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19012b7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.947601:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19012b7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603813.947613:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787603813.947617:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ed28654cd28 from 1 10000000:01000000:3.0:1787603813.947621:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787603813.947675:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.947684:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603813.947695:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603813.947772:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290177480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355167616:0@lo:101: 00000100:00100000:3.0:1787603813.947829:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603813.949720:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2984fd000 going to sleep for 11 seconds 00000100:00100000:1.0:1787603813.953581:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787603813.953614:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355167744:0@lo:400: 00000100:00100000:1.0:1787603813.953731:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603813.953826:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355167872:0@lo:400: 00000100:00100000:1.0:1787603813.953890:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603813.953948:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355167744 00000100:00100000:1.0:1787603813.953957:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355167744 00000100:00100000:0.0:1787603813.954430:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355167616 00000100:00100000:0.0:1787603813.954437:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355167616 00000100:00100000:0.0:1787603813.954479:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787603813.954491:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355167616:12345-0@lo:101: 00010000:00010000:0.0:1787603813.954511:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603813.954536:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a19012e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19012da expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603813.954569:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a19012e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19012da expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603813.954583:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a19012e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19012da expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603813.954594:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed280031a00, rc 0) 00000100:00100000:0.0:1787603813.954657:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355167616:12345-0@lo:101: Request processed in 168us (6828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603813.954676:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787603813.954777:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290177480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355167616:0@lo:101: 00010000:00010000:0.0:1787603813.954799:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19012e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603813.954810:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19012e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603813.954951:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355168000:0@lo:501: 00000100:00100000:2.0:1787603813.955020:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355167872 00000100:00100000:2.0:1787603813.955035:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355167872 00000100:00100000:2.0:1787603813.955103:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787603813.955112:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355167872:12345-0@lo:400: 00000100:00100000:2.0:1787603813.957094:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355167872:12345-0@lo:400: Request processed in 1974us (3193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603813.957108:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787603813.957164:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787603813.957231:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2b606f100 x1874438355167872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603813.957245:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355167872:0@lo:400: 00000100:00100000:1.0:1787603813.957818:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787603813.958934:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355167744:12345-0@lo:400: 00000100:00100000:1.0:1787603813.959082:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355167744:12345-0@lo:400: Request processed in 1250us (5351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603813.959094:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787603813.959830:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2b606c000 x1874438355167744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603813.959986:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355167744:0@lo:400: 00000100:00100000:0.0:1787603813.960594:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603813.960661:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2985ee9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787603813.960685:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355168000 00000100:00100000:0.0:1787603813.960693:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355168000 00000100:00100000:0.0:1787603813.960748:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787603813.960758:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355168000:12345-0@lo:501: 00000100:00100000:0.0:1787603813.963663:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355168000:12345-0@lo:501: Request processed in 2891us (3057us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787603813.963685:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787603813.963771:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355168000:0@lo:501: 10000000:01000000:0.0:1787603813.963824:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787603813.963869:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19012e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603813.963882:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19012e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787603814.026757:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787603814.089237:0:6872:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787603814.089284:0:6872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6872:1874438355168256:0@lo:7: 00000100:00100000:2.0:1787603814.089382:0:6872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603814.089454:0:6872:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf069300 going to sleep for 11 seconds 00000100:00100000:2.0:1787603814.089491:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355168128:0@lo:13: 00000100:00100000:2.0:1787603814.089520:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603814.089572:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355168256 00000100:00100000:2.0:1787603814.089580:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355168256 00000100:00100000:2.0:1787603814.089647:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787603814.089661:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6872:x1874438355168256:12345-0@lo:7: 00000100:00080000:3.0:1787603814.094047:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603814.094089:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355168128 00000100:00100000:3.0:1787603814.094100:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355168128 00000100:00100000:3.0:1787603814.094164:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787603814.094175:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355168128:12345-0@lo:13: 00002000:00000024:3.0:1787603814.094279:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787603814.094369:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355168128:12345-0@lo:13: Request processed in 195us (4848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603814.094376:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787603814.096355:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2ba36ce00 x1874438355168128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603814.096393:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355168128:0@lo:13: 00002000:00080000:3.0:1787603814.107986:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787603814.107998:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787603814.108106:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6872:x1874438355168256:12345-0@lo:7: Request processed in 18444us (18720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603814.108122:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787603814.108359:0:6872:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2ba36ed80 x1874438355168256/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787603830 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603814.108384:0:6872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6872:1874438355168256:0@lo:7: 00000004:00080000:2.0:1787603814.108407:0:6872:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787603814.108489:0:6872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6872:1874438355168384:0@lo:5: 00000100:00100000:2.0:1787603814.108549:0:6872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603814.108740:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355168384 00000100:00100000:0.0:1787603814.108756:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355168384 00000100:00100000:0.0:1787603814.108822:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787603814.108834:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6872:x1874438355168384:12345-0@lo:5: 00000100:00100000:2.0:1787603814.109181:0:6872:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf069300 going to sleep for 11 seconds 00002000:00080000:1.0:1787603814.109412:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787603814.109418:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787603814.110453:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6872:x1874438355168384:12345-0@lo:5: Request processed in 1615us (1896us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787603814.110474:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787603814.110566:0:6872:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2ba36ed80 x1874438355168384/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787603830 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603814.110590:0:6872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6872:1874438355168384:0@lo:5: 00000004:00080000:2.0:1787603814.110606:0:6872:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787603814.110655:0:6872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6872:1874438355168512:0@lo:700: 00000100:00100000:2.0:1787603814.110700:0:6872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603814.110772:0:6872:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf069300 going to sleep for 11 seconds 00000100:00100000:1.0:1787603814.110830:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355168512 00000100:00100000:1.0:1787603814.111071:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355168512 00000100:00100000:1.0:1787603814.111242:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787603814.111254:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6872:x1874438355168512:12345-0@lo:700: 00000100:00100000:1.0:1787603814.111299:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1874438355168640:0@lo:700: 00000100:00100000:1.0:1787603814.111339:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603814.111372:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295245a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787603814.111494:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355168640 00000100:00100000:2.0:1787603814.111499:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355168640 00000100:00100000:2.0:1787603814.111538:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787603814.111545:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1874438355168640:12345-0@lo:700: 40000000:02000000:2.0:1787603814.206574:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787603814.212752:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1874438355168640:12345-0@lo:700: Request processed in 101193us (101398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603814.212773:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787603814.212917:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2b606c000 x1874438355168640/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787603830 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603814.212936:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1874438355168640:0@lo:700: 40000000:02000000:3.0:1787603814.212955:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1787603814.329552:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1787603814.329577:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787603814.329811:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6872:x1874438355168512:12345-0@lo:700: Request processed in 218551us (219101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603814.329833:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787603814.332951:0:6872:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2ba36d180 x1874438355168512/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787603830 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603814.332971:0:6872:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787603814.333000:0:6872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6872:1874438355168512:0@lo:700: 00000004:02000040:1.0:1787603814.393513:0:6872:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787603814.397968:0:6872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6872:1874438355168768:0@lo:5: 00000100:00100000:1.0:1787603814.398076:0:6872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603814.400389:0:6872:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286692300 going to sleep for 11 seconds 00000100:00100000:1.0:1787603814.400444:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355168768 00000100:00100000:1.0:1787603814.400457:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355168768 00000100:00100000:1.0:1787603814.400529:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787603814.400542:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6872:x1874438355168768:12345-0@lo:5: 00002000:00080000:1.0:1787603814.419049:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787603814.419080:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787603814.426654:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6872:x1874438355168768:12345-0@lo:5: Request processed in 26099us (28565us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787603814.426674:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787603814.426785:0:6872:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2b606c380 x1874438355168768/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787603830 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603814.426809:0:6872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6872:1874438355168768:0@lo:5: 00000004:00080000:3.0:1787603814.426831:0:6872:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787603814.744309:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603815.771446:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603816.791197:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787603817.558146:0:7050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787603817.816177:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603818.840629:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603818.973877:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355169024:0@lo:400: 00000100:00100000:0.0:1787603818.973991:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603818.974064:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787603818.974071:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355168896:0@lo:400: 00000100:00100000:0.0:1787603818.974117:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603818.974431:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355169024 00000100:00100000:3.0:1787603818.974440:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355169024 00000100:00100000:3.0:1787603818.974507:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787603818.974517:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355169024:12345-0@lo:400: 00000100:00100000:3.0:1787603818.974577:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355169024:12345-0@lo:400: Request processed in 62us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603818.974585:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787603818.974611:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355168896 00000100:00100000:3.0:1787603818.974614:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355168896 00000100:00100000:3.0:1787603818.974635:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787603818.974642:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+16:3282:x1874438355168896:12345-0@lo:400: 00000100:00100000:3.0:1787603818.974672:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+16:3282:x1874438355168896:12345-0@lo:400: Request processed in 31us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603818.974678:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787603818.974720:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355168896:0@lo:400: 00010000:00080000:3.0:1787603818.974734:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed290174380 x1874438355169024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603818.974747:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355169024:0@lo:400: 00000100:00100000:2.0:1787603818.974866:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355169152:0@lo:400: 00000100:00100000:2.0:1787603818.974906:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603818.975049:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787603818.975055:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355169280:0@lo:400: 00000100:00100000:2.0:1787603818.975093:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603818.975130:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355169280 00000100:00100000:2.0:1787603818.975133:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355169280 00000100:00100000:2.0:1787603818.975183:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787603818.975190:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1874438355169280:12345-0@lo:400: 00000100:00100000:2.0:1787603818.975223:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1874438355169280:12345-0@lo:400: Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603818.975229:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787603818.975243:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787603818.975263:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed290177b80 x1874438355169280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603818.975274:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355169280:0@lo:400: 00000100:00100000:3.0:1787603818.975417:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355169152 00000100:00100000:3.0:1787603818.975422:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355169152 00000100:00100000:3.0:1787603818.975461:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787603818.975468:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355169152:12345-0@lo:400: 00000100:00100000:3.0:1787603818.975504:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355169152:12345-0@lo:400: Request processed in 37us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603818.975511:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787603818.982113:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787603818.982170:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed290175500 x1874438355169152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603818.982187:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355169152:0@lo:400: 00000100:00100000:0.0:1787603819.488689:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355169408:0@lo:13: 00000100:00100000:0.0:1787603819.488767:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603819.488888:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355169408 00000100:00100000:0.0:1787603819.488898:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355169408 00000100:00100000:0.0:1787603819.488953:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787603819.488966:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355169408:12345-0@lo:13: 00002000:00000024:0.0:1787603819.489002:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787603819.493983:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355169408:12345-0@lo:13: Request processed in 5011us (5206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603819.494001:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787603819.494066:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2c1b1fb80 x1874438355169408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603819.494104:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355169408:0@lo:13: 00000001:00080000:3.0:1787603819.615334:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787603819.863070:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603820.887097:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603821.911126:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603822.936909:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603823.964919:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603824.087260:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355169792:0@lo:400: 00000100:00100000:3.0:1787603824.087337:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603824.087409:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787603824.087942:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355169536:0@lo:400: 00000100:00100000:0.0:1787603824.087985:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603824.088015:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787603824.088035:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355169920:0@lo:400: 00000100:00100000:0.0:1787603824.088074:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603824.088103:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355169536 00000100:00100000:0.0:1787603824.088110:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355169536 00000100:00100000:0.0:1787603824.088153:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787603824.088162:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:3282:x1874438355169536:12345-0@lo:400: 00000100:00100000:0.0:1787603824.088208:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:3282:x1874438355169536:12345-0@lo:400: Request processed in 47us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603824.088215:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787603824.088256:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355169536:0@lo:400: 00000100:00100000:3.0:1787603824.088352:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355169664:0@lo:400: 00000100:00100000:3.0:1787603824.088384:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603824.088410:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355169792 00000100:00100000:3.0:1787603824.088414:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355169792 00000100:00100000:3.0:1787603824.088574:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355169664 00000100:00100000:3.0:1787603824.088578:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355169664 00000100:00100000:3.0:1787603824.088591:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787603824.088597:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355169792:12345-0@lo:400: 00000100:00100000:3.0:1787603824.088637:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355169792:12345-0@lo:400: Request processed in 40us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603824.088644:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787603824.088658:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787603824.088664:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355169664:12345-0@lo:400: 00000100:00100000:3.0:1787603824.088691:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355169664:12345-0@lo:400: Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603824.088696:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787603824.088728:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed290175f80 x1874438355169664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603824.088740:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355169664:0@lo:400: 00010000:00080000:3.0:1787603824.088750:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed290175500 x1874438355169792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603824.088759:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355169792:0@lo:400: 00000100:00100000:1.0:1787603824.089012:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355169920 00000100:00100000:1.0:1787603824.089018:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355169920 00000100:00100000:1.0:1787603824.089070:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787603824.089078:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355169920:12345-0@lo:400: 00000100:00100000:1.0:1787603824.089119:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355169920:12345-0@lo:400: Request processed in 43us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603824.089125:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787603824.089154:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed290177b80 x1874438355169920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603824.089163:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787603824.089173:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355169920:0@lo:400: 00000100:00080000:2.0:1787603824.091651:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787603824.091681:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603824.599719:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787603824.599756:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355170048:0@lo:13: 00000100:00100000:2.0:1787603824.600925:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603824.600994:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355170048 00000100:00100000:3.0:1787603824.601003:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355170048 00000100:00100000:2.0:1787603824.601079:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787603824.601098:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355170048:12345-0@lo:13: 00002000:00000024:2.0:1787603824.601136:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787603824.601194:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355170048:12345-0@lo:13: Request processed in 105us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603824.601201:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787603824.601326:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed290175500 x1874438355170048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603824.601347:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355170048:0@lo:13: 00010000:00010000:1.0:1787603824.986572:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603826.013004:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603827.032986:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603828.070323:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603829.084641:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603829.209269:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355170304:0@lo:400: 00000100:00100000:3.0:1787603829.209346:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603829.209411:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787603829.209417:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355170176:0@lo:400: 00000100:00100000:3.0:1787603829.209448:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603829.212767:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355170560:0@lo:400: 00000100:00100000:2.0:1787603829.212860:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603829.212896:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787603829.212903:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355170432:0@lo:400: 00000100:00100000:2.0:1787603829.212924:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603829.213099:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355170560 00000100:00100000:0.0:1787603829.213107:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355170560 00000100:00100000:0.0:1787603829.213167:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787603829.213175:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355170560:12345-0@lo:400: 00000100:00100000:0.0:1787603829.213228:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355170560:12345-0@lo:400: Request processed in 53us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603829.213234:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787603829.213788:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787603829.213824:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed290176d80 x1874438355170560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603829.213862:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355170560:0@lo:400: 00000100:00100000:0.0:1787603829.213935:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355170304 00000100:00100000:0.0:1787603829.213939:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355170304 00000100:00100000:0.0:1787603829.213971:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355170432 00000100:00100000:0.0:1787603829.213973:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355170432 00000100:00100000:0.0:1787603829.214010:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787603829.214017:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355170304:12345-0@lo:400: 00000100:00100000:0.0:1787603829.214060:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355170304:12345-0@lo:400: Request processed in 44us (4715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603829.214066:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787603829.214094:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787603829.214100:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355170432:12345-0@lo:400: 00000100:00100000:0.0:1787603829.214135:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355170432:12345-0@lo:400: Request processed in 35us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603829.214140:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787603829.214153:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787603829.214172:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed290176a00 x1874438355170432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603829.214181:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355170432:0@lo:400: 00000100:00100000:3.0:1787603829.215121:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355170176 00000100:00100000:3.0:1787603829.215132:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355170176 00000100:00100000:3.0:1787603829.215182:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787603829.215190:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+16:3284:x1874438355170176:12345-0@lo:400: 00000100:00100000:3.0:1787603829.215243:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+16:3284:x1874438355170176:12345-0@lo:400: Request processed in 54us (5794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603829.215250:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787603829.215292:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355170176:0@lo:400: 00010000:00080000:3.0:1787603829.215309:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed290175f80 x1874438355170304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603829.215319:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355170304:0@lo:400: 00000100:00100000:0.0:1787603829.720699:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787603829.720740:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355170688:0@lo:13: 00000100:00100000:0.0:1787603829.720817:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603829.720910:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355170688 00000100:00100000:0.0:1787603829.720918:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355170688 00000100:00100000:0.0:1787603829.720969:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787603829.720979:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355170688:12345-0@lo:13: 00002000:00000024:0.0:1787603829.721032:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603829.721081:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355170688:12345-0@lo:13: Request processed in 103us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603829.721089:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787603829.721135:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2c1b1ca80 x1874438355170688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603829.721158:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355170688:0@lo:13: 00000020:01000004:1.0:1787603829.727454:0:7613:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787603829.727463:0:7613:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787603829.727598:0:7613:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ed2b4d09000 00000020:01000004:1.0:1787603829.727615:0:7613:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787603829.727628:0:7613:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787603829.727643:0:7613:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ed2bf080000) 00000020:00000080:1.0:1787603829.727657:0:7613:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787603829.801081:0:7613:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787603829.801430:0:7613:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787603829.849493:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787603829.863309:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787603829.863357:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787603829.863800:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787603829.863865:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787603829.864700:0:7613:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787603829.864712:0:7613:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787603829.870319:0:7613:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb5d1f3b1a19012ef 00000020:01000004:2.0:1787603829.870337:0:7613:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787603829.870367:0:7613:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787603829.870370:0:7613:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787603829.870379:0:7613:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787603829.870406:0:7613:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787603829.870410:0:7613:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787603829.925801:0:7613:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787603829.925867:0:7613:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.121@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787603829.925871:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787603829.925873:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787603829.925874:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787603829.925875:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787603829.925876:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787603829.925877:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787603829.925879:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787603829.925880:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787603829.925881:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787603829.925883:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787603829.925884:0:7613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787603829.925887:0:7613:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787603829.925890:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787603829.925891:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787603829.925892:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787603829.925893:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787603829.925894:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787603829.925895:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787603829.925896:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787603829.925897:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787603829.925898:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787603829.925899:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787603829.925900:0:7613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787603829.925927:0:7613:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787603829.925946:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355170816:0@lo:253: 00000100:00100000:3.0:1787603829.926032:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603829.926096:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787603829.926478:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355170816 00000100:00100000:1.0:1787603829.926487:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355170816 00000100:00100000:1.0:1787603829.926552:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787603829.926563:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+16:7613:x1874438355170816:12345-0@lo:253: 20000000:01000000:1.0:1787603829.926595:0:5815:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787603829.926600:0:5815:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787603829.926605:0:5815:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787603829.926610:0:5815:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787603829.927641:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787603829.927830:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787603829.927868:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787603829.927902:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787603829.927908:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787603829.927944:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787603829.927983:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787603829.928363:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787603829.928383:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.121@tcp 20000000:01000000:1.0:1787603829.928385:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.121@tcp (null) (null) (null) 00000040:00080000:1.0:1787603829.928421:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787603829.928429:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787603829.928473:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787603829.928482:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.121@tcp (null) (null) 00000040:00080000:1.0:1787603829.928514:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787603829.928523:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787603829.928565:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787603829.928612:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787603829.929316:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787603829.929333:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.121@tcp 20000000:01000000:1.0:1787603829.929335:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.121@tcp (null) (null) (null) 00000040:00080000:1.0:1787603829.929367:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787603829.929374:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787603829.929399:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787603829.929405:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.121@tcp (null) (null) 00000040:00080000:1.0:1787603829.929426:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787603829.929433:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787603829.929470:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787603829.929505:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787603829.929520:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787603829.929523:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787603829.929526:0:5815:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787603829.929538:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787603829.929541:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787603829.929571:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787603829.929573:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787603829.931689:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787603829.932139:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787603829.932169:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787603829.932634:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787603829.932684:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787603829.933071:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787603829.933088:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787603829.933091:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787603829.933685:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787603829.934323:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787603829.934469:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787603829.935568:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787603829.935618:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787603829.935655:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787603829.935670:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787603829.935684:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787603829.936604:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787603829.937189:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787603829.937231:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787603829.937292:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787603829.937307:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787603829.937311:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787603829.939250:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787603829.939334:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787603829.939465:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787603829.940488:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787603829.940598:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787603829.940656:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787603829.940671:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787603829.940674:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787603829.940682:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787603829.940703:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.941224:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2813a1800/0xb5d1f3b1a1901247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901240 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.941232:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed281499200/0xb5d1f3b1a1901271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190126a expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.941238:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed280030800/0xb5d1f3b1a190129b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901294 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.941244:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a19012b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19012b0 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.941250:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a19012e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19012da expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.941256:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.941452:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a19012e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19012da expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.941478:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a19012e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19012da expref: 16 pid: 5816 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603829.941556:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874438355170944:0@lo:104: 00000100:00100000:0.0:1787603829.941623:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787603829.941708:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a19012b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19012b0 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.941726:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a19012b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19012b0 expref: 16 pid: 5815 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603829.941734:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874438355171072:0@lo:104: 00010000:00010000:0.0:1787603829.941764:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed280030800/0xb5d1f3b1a190129b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a1901294 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.941771:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed280030800/0xb5d1f3b1a190129b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901294 expref: 16 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603829.941778:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874438355171200:0@lo:104: 00010000:00010000:0.0:1787603829.941797:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed281499200/0xb5d1f3b1a1901271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190126a expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.941803:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed281499200/0xb5d1f3b1a1901271 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190126a expref: 16 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603829.941809:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874438355171328:0@lo:104: 00010000:00010000:0.0:1787603829.941824:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2813a1800/0xb5d1f3b1a1901247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a1901240 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.941873:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2813a1800/0xb5d1f3b1a1901247 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901240 expref: 16 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603829.941880:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874438355171456:0@lo:104: 00000100:00100000:0.0:1787603829.941904:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b4971240 going to sleep for 11 seconds 00000100:00100000:2.0:1787603829.942223:0:5805:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787603829.942243:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603829.944205:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603829.948428:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603829.948484:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355170944 00000100:00100000:3.0:1787603829.948504:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355170944 00000100:00100000:2.0:1787603829.955460:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603829.956145:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355171072 00000100:00100000:3.0:1787603829.956155:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355171072 00000100:00100000:3.0:1787603829.956171:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355171200 00000100:00100000:3.0:1787603829.956174:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355171200 00000100:00100000:3.0:1787603829.956184:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355171328 00000100:00100000:3.0:1787603829.956187:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355171328 00000100:00100000:3.0:1787603829.956195:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355171456 00000100:00100000:3.0:1787603829.956197:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355171456 00000100:00100000:3.0:1787603829.956212:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787603829.956222:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2888a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+7:5815:x1874438355170944:12345-0@lo:104: 00010000:00010000:3.0:1787603829.956242:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19012e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603829.956329:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787603829.956334:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2888a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+7:5815:x1874438355170944:12345-0@lo:104: Request processed in 114us (14711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603829.956341:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787603829.956389:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603829.956396:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19012e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603829.956404:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dadc00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603829.956408:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19012e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603829.956417:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19012e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603829.956435:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19012e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603829.956442:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787603829.956485:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19012e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603829.956491:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787603829.956907:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787603829.956919:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+6:5815:x1874438355171072:12345-0@lo:104: 00010000:00010000:2.0:1787603829.956927:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19012b7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.956993:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787603829.957000:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+6:5815:x1874438355171072:12345-0@lo:104: Request processed in 86us (14756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603829.957005:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787603829.957021:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787603829.957027:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+5:5815:x1874438355171200:12345-0@lo:104: 00010000:00010000:2.0:1787603829.957034:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a190129b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.957066:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787603829.957071:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+5:5815:x1874438355171200:12345-0@lo:104: Request processed in 45us (12873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603829.957077:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787603829.957092:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787603829.957097:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+4:5815:x1874438355171328:12345-0@lo:104: 00010000:00010000:2.0:1787603829.957104:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901271 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.957139:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787603829.957144:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+4:5815:x1874438355171328:12345-0@lo:104: Request processed in 48us (8725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603829.957150:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787603829.957163:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787603829.957171:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+3:5815:x1874438355171456:12345-0@lo:104: 00010000:00010000:2.0:1787603829.957178:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901247 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.957205:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787603829.957209:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+3:5815:x1874438355171456:12345-0@lo:104: Request processed in 40us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603829.957214:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787603829.957427:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787603829.957435:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19012b7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957442:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed281498c00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603829.957446:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19012b7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957453:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19012b7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787603829.957460:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19012b7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603829.957466:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787603829.957506:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19012b7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957512:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787603829.957533:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19012b7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957540:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed281498c00/0xb5d1f3b1a19012b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19012b7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957565:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787603829.957568:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a190129b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957574:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed280030400 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603829.957577:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a190129b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957584:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a190129b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787603829.957591:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a190129b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603829.957596:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787603829.957611:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190129b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957617:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787603829.957632:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190129b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957639:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a1901294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190129b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957649:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787603829.957652:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901271 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957668:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217da00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603829.957671:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1901271 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957677:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1901271 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787603829.957683:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1901271 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603829.957687:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787603829.957701:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901271 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.957706:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787603829.957712:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901271 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603829.958627:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19012e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603829.958637:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19012e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603829.958652:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603829.958655:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901247 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603829.958661:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2813a1c00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603829.958664:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1901247 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603829.958671:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1901247 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603829.958678:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1901247 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603829.958683:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787603829.958731:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901247 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603829.958737:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603829.958742:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901247 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.958852:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a190126a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901271 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.958862:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603829.958864:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603829.958866:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603829.958877:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603829.958905:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355171712:0@lo:103: 00000100:00100000:0.0:1787603829.958967:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603829.959103:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355172096:0@lo:103: 00000100:00100000:0.0:1787603829.959134:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603829.959160:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787603829.959166:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355171584:0@lo:103: 00000100:00100000:0.0:1787603829.959185:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603829.959217:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355171840:0@lo:103: 00000100:00100000:0.0:1787603829.959236:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603829.959253:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787603829.959259:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355171968:0@lo:103: 00000100:00100000:0.0:1787603829.959275:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603829.959303:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355171712 00000100:00100000:0.0:1787603829.959311:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355171712 00010000:00010000:0.0:1787603829.959341:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a19012b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19012b0 expref: 17 pid: 5815 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603829.959359:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355172096 00000100:00100000:0.0:1787603829.959362:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355172096 00010000:00010000:0.0:1787603829.959373:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2813a1800/0xb5d1f3b1a1901247 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901240 expref: 18 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603829.959382:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355171584 00000100:00100000:0.0:1787603829.959385:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355171584 00010000:00010000:0.0:1787603829.959394:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a19012e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19012da expref: 19 pid: 5816 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603829.959402:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355171840 00000100:00100000:0.0:1787603829.959404:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355171840 00010000:00010000:0.0:1787603829.959413:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed280030800/0xb5d1f3b1a190129b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901294 expref: 20 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603829.959422:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355171968 00000100:00100000:0.0:1787603829.959431:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355171968 00010000:00010000:0.0:1787603829.959447:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed281499200/0xb5d1f3b1a1901271 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190126a expref: 21 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603829.959462:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787603829.959470:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a643876-f930-492c-81cb-9dcff9ce6b60+21:3284:x1874438355171712:12345-0@lo:103: 00010000:00010000:0.0:1787603829.959484:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603829.959489:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a19012b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19012b0 expref: 21 pid: 5815 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603829.959678:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901240 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901247 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603829.959695:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603829.959697:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603829.959699:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603829.960007:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787603829.960019:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+21:3284:x1874438355172096:12345-0@lo:103: 00010000:00010000:2.0:1787603829.960028:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603829.960033:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2813a1800/0xb5d1f3b1a1901247 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901240 expref: 21 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.960044:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2813a1800/0xb5d1f3b1a1901247 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901240 expref: 21 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.960062:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603829.960105:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+21:3284:x1874438355172096:12345-0@lo:103: Request processed in 91us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603829.960113:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787603829.960132:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787603829.960147:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+20:3284:x1874438355171584:12345-0@lo:103: 00010000:00010000:2.0:1787603829.960155:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603829.960159:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a19012e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19012da expref: 20 pid: 5816 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.960169:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a19012e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19012da expref: 20 pid: 5816 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.960179:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603829.960202:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+20:3284:x1874438355171584:12345-0@lo:103: Request processed in 57us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603829.960208:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787603829.960222:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787603829.960228:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355171840:12345-0@lo:103: 00010000:00010000:2.0:1787603829.960235:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603829.960239:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed280030800/0xb5d1f3b1a190129b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901294 expref: 19 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.960246:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed280030800/0xb5d1f3b1a190129b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901294 expref: 19 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.960255:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603829.960280:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355171840:12345-0@lo:103: Request processed in 53us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603829.960287:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787603829.960300:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787603829.960306:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:3281:x1874438355171968:12345-0@lo:103: 00010000:00010000:2.0:1787603829.960312:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603829.960324:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed281499200/0xb5d1f3b1a1901271 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190126a expref: 18 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.960332:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed281499200/0xb5d1f3b1a1901271 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190126a expref: 18 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.960342:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603829.960364:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:3281:x1874438355171968:12345-0@lo:103: Request processed in 59us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603829.960371:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787603829.960422:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a19012e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19012da expref: 17 pid: 5816 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603829.960435:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874438355170944:0@lo:104: 00000100:00100000:2.0:1787603829.960446:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874438355171072:0@lo:104: 00010000:00010000:2.0:1787603829.960455:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed280030800/0xb5d1f3b1a190129b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a1901294 expref: 16 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603829.960464:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874438355171200:0@lo:104: 00010000:00010000:2.0:1787603829.960474:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed281499200/0xb5d1f3b1a1901271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190126a expref: 15 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603829.960482:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874438355171328:0@lo:104: 00010000:00010000:2.0:1787603829.960503:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2813a1800/0xb5d1f3b1a1901247 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a1901240 expref: 14 pid: 5813 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603829.960512:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874438355171456:0@lo:104: 00010000:00010000:2.0:1787603829.960542:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603829.961236:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355171968:0@lo:103: 00000100:00100000:1.0:1787603829.961247:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355171840:0@lo:103: 00000100:00100000:1.0:1787603829.961289:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355171584:0@lo:103: 00000100:00100000:1.0:1787603829.961297:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355172096:0@lo:103: 00010000:00010000:0.0:1787603829.961606:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a19012b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19012b0 expref: 13 pid: 5815 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.961623:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a19012b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19012b0 expref: 13 pid: 5815 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.961638:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.961645:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.961662:0:6693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.961669:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.961675:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.961682:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.961694:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217dc00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787603829.961699:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.961708:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.961729:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603829.961740:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787603829.962149:0:5815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.962158:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603829.962164:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19012f6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787603829.962179:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787603829.962369:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a643876-f930-492c-81cb-9dcff9ce6b60+12:3284:x1874438355171712:12345-0@lo:103: Request processed in 2897us (3400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603829.962378:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787603829.962923:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355171712:0@lo:103: 00000100:00100000:2.0:1787603830.024651:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+11:7613:x1874438355170816:12345-0@lo:253: Request processed in 98081us (98611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.024667:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787603830.024829:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355170816:0@lo:253: 10000000:01000000:3.0:1787603830.024863:0:7613:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787603830.024866:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787603830.024868:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787603830.024869:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787603830.024870:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787603830.024871:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787603830.024872:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787603830.024874:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787603830.024875:0:7613:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787603830.024877:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787603830.024878:0:7613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787603830.024900:0:7613:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ed2b4d09000 from lustre-OST0001 10000000:01000000:3.0:1787603830.024925:0:7613:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787603830.024928:0:7613:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787603830.024937:0:7613:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ed28654cd28 local copy 10000000:01000000:3.0:1787603830.024943:0:7613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787603830.024995:0:7613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.025005:0:7613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.025028:0:7613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603830.025047:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355172224:0@lo:101: 00000100:00100000:3.0:1787603830.025083:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603830.025122:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.025237:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355172224 00000100:00100000:2.0:1787603830.025245:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355172224 00000100:00100000:2.0:1787603830.025288:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787603830.025296:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+11:7613:x1874438355172224:12345-0@lo:101: 00010000:00010000:2.0:1787603830.025307:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603830.025320:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a1901304 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19012fd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.025342:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a1901304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19012fd expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.025351:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a1901304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19012fd expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.025361:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217dc00, rc 0) 00000100:00100000:2.0:1787603830.025399:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:7613:x1874438355172224:12345-0@lo:101: Request processed in 103us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.025410:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787603830.025503:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355172224:0@lo:101: 00010000:00010000:1.0:1787603830.025517:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb5d1f3b1a1901304 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.025526:0:7613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb5d1f3b1a1901304 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603830.025619:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355172352:0@lo:501: 00000100:00100000:1.0:1787603830.025646:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603830.025665:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc27840 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.025821:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355172352 00000100:00100000:2.0:1787603830.025826:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355172352 00000100:00100000:2.0:1787603830.025881:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787603830.025887:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+12:7613:x1874438355172352:12345-0@lo:501: 00000100:00100000:2.0:1787603830.026207:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+12:7613:x1874438355172352:12345-0@lo:501: Request processed in 320us (560us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787603830.026215:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787603830.026280:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355172352:0@lo:501: 10000000:01000000:1.0:1787603830.026291:0:7613:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787603830.026315:0:7613:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787603830.026320:0:7613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb5d1f3b1a1901304 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.026329:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb5d1f3b1a1901304 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.026336:0:7613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb5d1f3b1a1901304 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.026358:0:7613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787603830.026385:0:7613:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ed2b4d09000 10000000:01000000:1.0:1787603830.026390:0:7613:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787603830.026394:0:7613:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787603830.026396:0:7613:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787603830.026400:0:7613:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787603830.026403:0:7613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787603830.026420:0:7613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.026426:0:7613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.026434:0:7613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603830.026445:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355172480:0@lo:101: 00000100:00100000:1.0:1787603830.026474:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603830.026510:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603830.026524:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355172480 00000100:00100000:1.0:1787603830.026528:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355172480 00000100:00100000:1.0:1787603830.026552:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787603830.026558:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:7613:x1874438355172480:12345-0@lo:101: 00010000:00010000:1.0:1787603830.026566:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603830.026574:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2813a1c00/0xb5d1f3b1a1901312 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190130b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.026589:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2813a1c00/0xb5d1f3b1a1901312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190130b expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.026597:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2813a1c00/0xb5d1f3b1a1901312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190130b expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.026611:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2813a1c00, rc 0) 00000100:00100000:1.0:1787603830.026638:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355172480:12345-0@lo:101: Request processed in 79us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603830.026643:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787603830.026671:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355172480:0@lo:101: 00010000:00010000:1.0:1787603830.026682:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901312 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.026690:0:7613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901312 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603830.026888:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355172608:0@lo:501: 00000100:00100000:1.0:1787603830.026916:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603830.026929:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603830.026942:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355172608 00000100:00100000:1.0:1787603830.026945:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355172608 00000100:00100000:1.0:1787603830.026966:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787603830.026971:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355172608:12345-0@lo:501: 00000100:00100000:1.0:1787603830.027163:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355172608:12345-0@lo:501: Request processed in 191us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603830.027169:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787603830.027195:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355172608:0@lo:501: 00000100:00100000:1.0:1787603830.027216:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355172736:0@lo:503: 00000100:00100000:1.0:1787603830.027251:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603830.027262:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603830.027279:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355172736 00000100:00100000:1.0:1787603830.027283:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355172736 00000100:00100000:1.0:1787603830.027298:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787603830.027302:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355172736:12345-0@lo:503: 00000100:00100000:1.0:1787603830.027423:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355172736:12345-0@lo:503: Request processed in 119us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603830.027428:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787603830.027462:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355172736:0@lo:503: 00000040:00080000:1.0:1787603830.027922:0:7613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787603830.028047:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355172864:0@lo:502: 00000100:00100000:1.0:1787603830.028085:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603830.028100:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603830.028115:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355172864 00000100:00100000:1.0:1787603830.028119:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355172864 00000100:00100000:1.0:1787603830.028139:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787603830.028144:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355172864:12345-0@lo:502: 00000100:00100000:1.0:1787603830.028262:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355172864:12345-0@lo:502: Request processed in 117us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603830.028270:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787603830.028306:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355172864:0@lo:502: 00010000:00010000:2.0:1787603830.028609:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787603830.028617:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb5d1f3b1a1901304 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.028627:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dadc00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:2.0:1787603830.028630:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb5d1f3b1a1901304 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.028639:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb5d1f3b1a1901304 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787603830.028646:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb5d1f3b1a1901304 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787603830.028652:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787603830.028674:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb5d1f3b1a1901304 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.028680:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787603830.028703:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb5d1f3b1a1901304 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.028787:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19012fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb5d1f3b1a1901304 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.028801:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603830.028802:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603830.028805:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603830.028817:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355172992:0@lo:103: 00000100:00100000:2.0:1787603830.028881:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603830.028920:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355172992 00000100:00100000:2.0:1787603830.028924:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355172992 00000100:00100000:2.0:1787603830.028951:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787603830.028957:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:3281:x1874438355172992:12345-0@lo:103: 00010000:00010000:2.0:1787603830.028966:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603830.029057:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a1901304 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a19012fd expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.029070:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603830.029097:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+12:3281:x1874438355172992:12345-0@lo:103: Request processed in 140us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.029102:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787603830.029142:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355172992:0@lo:103: 00000040:00080000:1.0:1787603830.029323:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787603830.029375:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787603830.029400:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787603830.029434:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787603830.029466:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787603830.029657:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787603830.029689:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173120:0@lo:502: 00000100:00100000:1.0:1787603830.029824:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603830.029964:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc273c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.030102:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355173120 00000100:00100000:2.0:1787603830.030107:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355173120 00000100:00100000:0.0:1787603830.030219:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787603830.030228:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:7613:x1874438355173120:12345-0@lo:502: 00000100:00100000:0.0:1787603830.030392:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+12:7613:x1874438355173120:12345-0@lo:502: Request processed in 165us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603830.030399:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787603830.030469:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173120:0@lo:502: 00000040:00080000:1.0:1787603830.030586:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787603830.030596:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787603830.031364:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787603830.031373:0:7621:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787603830.031379:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787603830.031382:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787603830.031387:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787603830.031401:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ed2bf0819b8) 00000020:00000080:1.0:1787603830.031421:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787603830.031426:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787603830.031482:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ed2b4d09000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787603830.031489:0:7621:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787603830.031565:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb5d1f3b1a1901320 00010000:00010000:1.0:1787603830.043314:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787603830.048314:0:7621:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787603830.065440:0:7621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787603830.066316:0:7621:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787603830.079025:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787603830.082204:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787603830.090094:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787603830.090119:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787603830.090126:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787603830.090128:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787603830.090132:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787603830.090136:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787603830.090137:0:7621:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787603830.090140:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787603830.090142:0:7621:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787603830.090212:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787603830.090216:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787603830.090217:0:7621:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787603830.090220:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787603830.090651:0:7613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787603830.090678:0:7613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787603830.090747:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901312 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.090760:0:7613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901312 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603830.090769:0:7613:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed2b4d09000 from 1 10000000:01000000:1.0:1787603830.090772:0:7613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787603830.090806:0:7613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.090824:0:7613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.090864:0:7613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603830.090891:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173248:0@lo:101: 00000100:00100000:1.0:1787603830.090966:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603830.091024:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc27240 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.091905:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355173248 00000100:00100000:2.0:1787603830.091914:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355173248 00000100:00100000:2.0:1787603830.091969:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787603830.091979:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:7613:x1874438355173248:12345-0@lo:101: 00010000:00010000:2.0:1787603830.092005:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603830.092020:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a190132e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901327 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.092047:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a190132e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901327 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.092057:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a190132e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901327 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.092065:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217dc00, rc 0) 00000100:00100000:2.0:1787603830.092129:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355173248:12345-0@lo:101: Request processed in 151us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.092136:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787603830.092230:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173248:0@lo:101: 00010000:00010000:1.0:1787603830.092245:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190132e expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.092253:0:7613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190132e expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603830.092351:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173376:0@lo:501: 00000100:00100000:1.0:1787603830.092382:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603830.092421:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc27240 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.092473:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355173376 00000100:00100000:2.0:1787603830.092487:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355173376 00000100:00100000:2.0:1787603830.092636:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787603830.092644:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355173376:12345-0@lo:501: 00000100:00100000:2.0:1787603830.092949:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355173376:12345-0@lo:501: Request processed in 305us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.092957:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787603830.093080:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173376:0@lo:501: 00000100:00100000:1.0:1787603830.093107:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173504:0@lo:503: 00000100:00100000:1.0:1787603830.093147:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603830.093173:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc27240 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.093218:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355173504 00000100:00100000:2.0:1787603830.093222:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355173504 00000100:00100000:2.0:1787603830.093247:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787603830.093253:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355173504:12345-0@lo:503: 00000100:00100000:2.0:1787603830.093689:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355173504:12345-0@lo:503: Request processed in 434us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.093696:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787603830.093957:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173504:0@lo:503: 00000040:00080000:0.0:1787603830.094681:0:7613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787603830.094759:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173632:0@lo:502: 00000100:00100000:0.0:1787603830.094820:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603830.095028:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b4971840 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.095075:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355173632 00000100:00100000:2.0:1787603830.095083:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355173632 00000100:00100000:2.0:1787603830.097389:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787603830.097410:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355173632:12345-0@lo:502: 00000100:00100000:2.0:1787603830.097732:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355173632:12345-0@lo:502: Request processed in 329us (2911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.097741:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787603830.098129:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173632:0@lo:502: 00000040:00080000:0.0:1787603830.098389:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787603830.098438:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787603830.098473:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173760:0@lo:502: 00000100:00100000:0.0:1787603830.098694:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603830.098766:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b4971840 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.098807:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355173760 00000100:00100000:2.0:1787603830.098813:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355173760 00000100:00100000:2.0:1787603830.098974:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787603830.098990:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355173760:12345-0@lo:502: 00000100:00100000:2.0:1787603830.099203:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355173760:12345-0@lo:502: Request processed in 221us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.099210:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787603830.099312:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173760:0@lo:502: 00000040:00080000:1.0:1787603830.099441:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787603830.099457:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787603830.100102:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787603830.100113:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787603830.100115:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787603830.100121:0:7625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ed2b4d09000 00000020:00000080:0.0:1787603830.100123:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787603830.100140:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787603830.100142:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787603830.100143:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787603830.100145:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787603830.100268:0:7613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787603830.100288:0:7613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787603830.100333:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190132e expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.100343:0:7613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190132e expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603830.100380:0:7613:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787603830.100383:0:7613:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ed2b4d09000 10000000:01000000:1.0:1787603830.100386:0:7613:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ed2b4d09000 10000000:01000000:1.0:1787603830.100390:0:7613:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787603830.100395:0:7613:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ed2b4d09000 from 1 10000000:01000000:1.0:1787603830.100397:0:7613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787603830.100424:0:7613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.100431:0:7613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603830.100440:0:7613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603830.100456:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173888:0@lo:101: 00000100:00100000:1.0:1787603830.100506:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603830.100671:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc27000 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.100784:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355173888 00000100:00100000:2.0:1787603830.100791:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355173888 00000100:00100000:2.0:1787603830.100831:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787603830.100866:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355173888:12345-0@lo:101: 00010000:00010000:2.0:1787603830.100877:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603830.100889:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a190133c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901335 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.100909:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a190133c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901335 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.100918:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a190133c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901335 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.100926:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217de00, rc 0) 00000100:00100000:2.0:1787603830.100965:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+14:7613:x1874438355173888:12345-0@lo:101: Request processed in 102us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.100972:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787603830.101032:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355173888:0@lo:101: 00010000:00010000:2.0:1787603830.101046:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190133c expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.101055:0:7613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190133c expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603830.101133:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355174016:0@lo:501: 00000100:00100000:2.0:1787603830.101160:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603830.101181:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355174016 00000100:00100000:2.0:1787603830.101185:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355174016 00000100:00100000:2.0:1787603830.101214:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787603830.101219:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:7613:x1874438355174016:12345-0@lo:501: 00000100:00100000:2.0:1787603830.101414:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:7613:x1874438355174016:12345-0@lo:501: Request processed in 193us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.101420:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787603830.101452:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.101464:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355174016:0@lo:501: 00000100:00100000:2.0:1787603830.101489:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355174144:0@lo:503: 00000100:00100000:2.0:1787603830.101726:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603830.101770:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787603830.101804:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355174144 00000100:00100000:0.0:1787603830.101809:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355174144 00000100:00100000:0.0:1787603830.101920:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787603830.101927:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:7613:x1874438355174144:12345-0@lo:503: 00000100:00100000:0.0:1787603830.102121:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:7613:x1874438355174144:12345-0@lo:503: Request processed in 194us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603830.102128:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787603830.102258:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355174144:0@lo:503: 00000040:00080000:1.0:1787603830.102547:0:7613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787603830.102610:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355174272:0@lo:502: 00000100:00100000:1.0:1787603830.102650:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603830.102905:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc27840 going to sleep for 11 seconds 00000100:00100000:0.0:1787603830.102991:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355174272 00000100:00100000:0.0:1787603830.102997:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355174272 00000100:00100000:0.0:1787603830.103059:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787603830.103067:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:7613:x1874438355174272:12345-0@lo:502: 00000100:00100000:0.0:1787603830.103314:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:7613:x1874438355174272:12345-0@lo:502: Request processed in 248us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603830.103321:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787603830.103388:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355174272:0@lo:502: 00000040:00080000:1.0:1787603830.103633:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787603830.103674:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787603830.103699:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787603830.103731:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787603830.103758:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787603830.103813:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787603830.103925:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787603830.103962:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787603830.104018:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787603830.104071:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787603830.104127:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787603830.104198:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787603830.104229:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787603830.104256:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787603830.104309:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787603830.104355:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787603830.104384:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787603830.104439:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787603830.104477:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00010000:00010000:2.0:1787603830.104548:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787603830.108163:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787603830.108440:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787603830.108490:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787603830.108524:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787603830.108575:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787603830.108632:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787603830.108685:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787603830.108734:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787603830.108771:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787603830.108804:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787603830.109080:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787603830.109121:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787603830.109156:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787603830.109184:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787603830.109221:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787603830.109248:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787603830.109287:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787603830.109319:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787603830.109367:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355174400:0@lo:502: 00000100:00100000:0.0:1787603830.110077:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603830.110130:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b4971c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.110948:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355174400 00000100:00100000:2.0:1787603830.110959:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355174400 00000100:00100000:2.0:1787603830.111031:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787603830.111041:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:7613:x1874438355174400:12345-0@lo:502: 00000100:00100000:2.0:1787603830.111296:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:7613:x1874438355174400:12345-0@lo:502: Request processed in 256us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.111304:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787603830.115194:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355174400:0@lo:502: 00000040:00080000:0.0:1787603830.115358:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787603830.115374:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787603830.117813:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787603830.117888:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ed2ba1eb370) 00000020:00000080:3.0:1787603830.117921:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787603830.118021:0:7626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ed2b4d09000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787603830.118025:0:7626:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ed2b4d09000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787603830.118028:0:7626:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ed2b4d09000 3 00010000:00080000:3.0:1787603830.118058:0:7626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ed2c1c8e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.121@tcp at head 00010000:00010000:3.0:1787603830.119633:0:7626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787603830.119821:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787603830.119885:0:7626:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787603830.119898:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb5d1f3b1a190134a 00000100:00080000:3.0:1787603830.119908:0:7626:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787603830.119914:0:7626:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ed2c1c8e000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:3.0:1787603830.119950:0:7626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed290177800 x1874438355174528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787603830.119976:0:7626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787603830.120084:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355174656:0@lo:400: 00000100:00100000:3.0:1787603830.120151:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603830.120204:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355174784:0@lo:400: 00000100:00100000:3.0:1787603830.120228:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603830.120257:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787603830.120262:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355174912:0@lo:400: 00000100:00100000:3.0:1787603830.120290:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603830.120328:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355174656 00000100:00100000:3.0:1787603830.120335:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355174656 00000100:00100000:3.0:1787603830.120372:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355174784 00000100:00100000:3.0:1787603830.120374:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355174784 00000100:00100000:3.0:1787603830.120389:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787603830.120397:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355174656:12345-0@lo:400: 00000100:00100000:3.0:1787603830.120459:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355174656:12345-0@lo:400: Request processed in 61us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603830.120466:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787603830.120481:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787603830.120487:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355174784:12345-0@lo:400: 00000100:00100000:3.0:1787603830.120517:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355174784:12345-0@lo:400: Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603830.120523:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787603830.120549:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355174912 00000100:00100000:3.0:1787603830.120552:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355174912 00000100:00100000:3.0:1787603830.120576:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787603830.120581:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355174912:12345-0@lo:400: 00000100:00100000:3.0:1787603830.120605:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355174912:12345-0@lo:400: Request processed in 25us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603830.120610:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787603830.120640:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed290174700 x1874438355174912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603830.120651:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355174912:0@lo:400: 00010000:00080000:3.0:1787603830.120669:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed290174e00 x1874438355174784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603830.120676:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355174784:0@lo:400: 00010000:00080000:3.0:1787603830.120697:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed290175500 x1874438355174656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603830.120703:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355174656:0@lo:400: 00000100:00100000:2.0:1787603830.122566:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874438355174528:0@lo:38: 00000100:00100000:2.0:1787603830.122636:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603830.122703:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355174528 00000100:00100000:2.0:1787603830.122709:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355174528 00000100:00100000:2.0:1787603830.122741:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787603830.122748:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874438355174528:12345-0@lo:38: 00010000:00080000:2.0:1787603830.122772:0:5821:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:2.0:1787603830.122809:0:5821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb5d1f3b1a1901351 00000004:00100000:2.0:1787603830.122829:0:5821:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787603830.122882:0:5821:0:(import.c:65:import_set_state_nolock()) ffff9ed2bfd51800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787603830.122928:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874438355174528:12345-0@lo:38: Request processed in 179us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.122934:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787603830.122968:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed290177800 x1874438355174528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787603840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603830.122978:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787603830.122996:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787603830.123003:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787603830.123008:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787603830.123010:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2c1c8e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787603830.123015:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874438355174528:0@lo:38: 00000040:00080000:3.0:1787603830.133712:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1787603830.136002:0:7613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787603830.136051:0:7613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787603830.136075:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190133c expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.136088:0:7613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190133c expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787603830.136167:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787603830.136169:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787603830.136170:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787603830.136171:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787603830.136173:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787603830.136174:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787603830.136175:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787603830.136177:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787603830.136178:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787603830.136184:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787603830.136185:0:7613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787603830.136189:0:7613:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787603830.136191:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787603830.136192:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787603830.136193:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787603830.136194:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787603830.136194:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787603830.136195:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787603830.136196:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787603830.136197:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787603830.136198:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787603830.136198:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787603830.136199:0:7613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787603830.136225:0:7613:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787603830.136245:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355175040:0@lo:253: 00000100:00100000:2.0:1787603830.136334:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603830.136374:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355175040 00000100:00100000:2.0:1787603830.136381:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355175040 00000100:00100000:2.0:1787603830.136419:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787603830.136426:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:7613:x1874438355175040:12345-0@lo:253: 20000000:01000000:2.0:1787603830.136448:0:5813:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787603830.136463:0:5813:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787603830.136960:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787603830.151365:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7627:1874438355175168:0@lo:901: 00000100:00100000:3.0:1787603830.151438:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603830.151473:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.151531:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355175168 00000100:00100000:2.0:1787603830.151538:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355175168 00000100:00100000:2.0:1787603830.151597:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787603830.151606:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7627:x1874438355175168:12345-0@lo:901: 00000100:00100000:2.0:1787603830.152014:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7627:x1874438355175168:12345-0@lo:901: Request processed in 407us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.152021:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787603830.152092:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787603830.155194:0:7627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed290175500 x1874438355175168/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787603846 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603830.155212:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7627:1874438355175168:0@lo:901: 20000000:01000000:2.0:1787603830.165698:0:5813:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787603830.165725:0:5813:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787603830.165784:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787603830.165789:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787603830.165811:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.165830:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19012a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19012a2 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.165863:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.165900:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19012a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19012a2 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.165924:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19012a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19012a2 expref: 14 pid: 5815 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603830.165939:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1874438355175296:0@lo:104: 00000100:00100000:3.0:1787603830.166014:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603830.166060:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603830.166209:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355175296 00000100:00100000:2.0:1787603830.166218:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355175296 00000100:00100000:2.0:1787603830.166267:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787603830.166276:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290174700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+3:5838:x1874438355175296:12345-0@lo:104: 00010000:00010000:2.0:1787603830.166290:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19012a9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603830.166335:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787603830.166341:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290174700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+3:5838:x1874438355175296:12345-0@lo:104: Request processed in 67us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603830.166347:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787603830.166413:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1874438355175296:0@lo:104: 00010000:00010000:3.0:1787603830.166430:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.166445:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603830.166451:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19012a9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.166458:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2813a0e00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603830.166461:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19012a9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.166470:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19012a9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603830.166477:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19012a9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603830.166482:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787603830.166571:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19012a9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.166578:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603830.166603:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19012a9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.166609:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a19012a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19012a9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.166626:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603830.166627:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603830.166629:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603830.166640:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355175424:0@lo:103: 00000100:00100000:3.0:1787603830.166672:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603830.166700:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355175424 00000100:00100000:3.0:1787603830.166704:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355175424 00010000:00010000:3.0:1787603830.167123:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19012a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19012a2 expref: 15 pid: 5815 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603830.167156:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787603830.167164:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa48e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+15:3281:x1874438355175424:12345-0@lo:103: 00010000:00010000:3.0:1787603830.167175:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603830.167180:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19012a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19012a2 expref: 15 pid: 5815 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167190:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19012a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19012a2 expref: 15 pid: 5815 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167203:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a19012a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19012a2 expref: 15 pid: 5815 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167216:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167236:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787603830.167249:0:5806:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003196166s 00010000:00010000:3.0:1787603830.167253:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167260:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167267:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167273:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167279:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dade00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787603830.167283:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167290:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167303:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167312:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603830.167346:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa48e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:3281:x1874438355175424:12345-0@lo:103: Request processed in 184us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603830.167353:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787603830.167420:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167427:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603830.167432:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901358 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603830.167468:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355175424:0@lo:103: 00000100:00100000:1.0:1787603830.185256:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:7613:x1874438355175040:12345-0@lo:253: Request processed in 48820us (48913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603830.185273:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787603830.185343:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9a643876-f930-492c-81cb-9dcff9ce6b60:7613:1874438355175040:0@lo:253: 10000000:01000000:2.0:1787603830.185361:0:7613:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787603830.185363:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787603830.185365:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787603830.185366:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787603830.185367:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787603830.185368:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787603830.185369:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787603830.185371:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787603830.185372:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787603830.185374:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787603830.185375:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787603830.185377:0:7613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787603830.185393:0:7613:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787603830.192676:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787603830.194358:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787603830.194623:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787603830.196171:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787603830.196430:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787603830.196702:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787603830.203036:0:7613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787603830.545119:0:7613:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787603830.545130:0:7613:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787603830.545175:0:7613:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787603830.545239:0:7613:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.121@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787603830.545252:0:7613:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787603830.545283:0:7613:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787603831.127306:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603832.151590:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603833.180474:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603834.199008:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603834.839081:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355175552:0@lo:13: 00000100:00100000:3.0:1787603834.839153:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603834.839388:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355175552 00000100:00100000:0.0:1787603834.839408:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355175552 00000100:00100000:0.0:1787603834.839476:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787603834.839486:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355175552:12345-0@lo:13: 00002000:00000024:0.0:1787603834.839523:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603834.839570:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355175552:12345-0@lo:13: Request processed in 86us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603834.839589:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787603834.839635:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2c1b1d880 x1874438355175552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603834.839654:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355175552:0@lo:13: 00000100:00080000:3.0:1787603834.840087:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787603835.224885:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603835.353718:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355175808:0@lo:400: 00000100:00100000:1.0:1787603835.353798:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603835.353873:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787603835.353880:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355175680:0@lo:400: 00000100:00100000:1.0:1787603835.353911:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603835.353934:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355176192:0@lo:400: 00000100:00100000:1.0:1787603835.353976:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603835.354002:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355175936:0@lo:400: 00000100:00100000:1.0:1787603835.354024:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603835.354042:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787603835.354047:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355176064:0@lo:400: 00000100:00100000:1.0:1787603835.354072:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603835.354102:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355175808 00000100:00100000:1.0:1787603835.354109:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355175808 00000100:00100000:1.0:1787603835.354146:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355176192 00000100:00100000:1.0:1787603835.354149:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355176192 00000100:00100000:1.0:1787603835.354174:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355175936 00000100:00100000:1.0:1787603835.354176:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355175936 00000100:00100000:1.0:1787603835.354191:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787603835.354200:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355175808:12345-0@lo:400: 00000100:00100000:0.0:1787603835.354385:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787603835.354395:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787603835.354415:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787603835.354423:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787603835.354431:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355176192:12345-0@lo:400: 00000100:00100000:1.0:1787603835.354487:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355175808:12345-0@lo:400: Request processed in 287us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603835.354495:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787603835.354513:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787603835.354519:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787603835.354537:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355175936:12345-0@lo:400: 00000100:00100000:1.0:1787603835.354570:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355175936:12345-0@lo:400: Request processed in 34us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603835.354575:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787603835.354594:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355176064 00000100:00100000:1.0:1787603835.354598:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355176064 00000100:00100000:1.0:1787603835.354622:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787603835.354629:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355176064:12345-0@lo:400: 00000100:00100000:1.0:1787603835.354659:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355176064:12345-0@lo:400: Request processed in 30us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603835.354664:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787603835.354681:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787603835.354712:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b606c000 x1874438355176064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603835.354724:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355176064:0@lo:400: 00010000:00080000:1.0:1787603835.354735:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b606c380 x1874438355175936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603835.354744:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355175936:0@lo:400: 00010000:00080000:1.0:1787603835.361022:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b606f100 x1874438355176192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603835.361044:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355176192:0@lo:400: 00010000:00080000:1.0:1787603835.361059:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b606dc00 x1874438355175808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603835.361067:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355175808:0@lo:400: 00000100:00100000:1.0:1787603835.361900:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355175680 00000100:00100000:1.0:1787603835.361919:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355175680 00000100:00100000:1.0:1787603835.361986:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787603835.361996:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:3284:x1874438355175680:12345-0@lo:400: 00000100:00100000:1.0:1787603835.362079:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:3284:x1874438355175680:12345-0@lo:400: Request processed in 84us (8166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603835.362086:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787603835.362133:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355175680:0@lo:400: 00000100:00100000:0.0:1787603835.369433:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355176192:12345-0@lo:400: Request processed in 14989us (15442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603835.369449:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787603836.256286:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603837.275623:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787603837.304724:0:7972:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787603838.296080:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603839.319080:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603839.960764:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787603839.960792:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355176320:0@lo:13: 00000100:00100000:3.0:1787603839.960884:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603839.961486:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355176320 00000100:00100000:0.0:1787603839.961497:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355176320 00000100:00100000:0.0:1787603839.961566:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787603839.961576:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355176320:12345-0@lo:13: 00002000:00000024:0.0:1787603839.961610:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603839.961659:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355176320:12345-0@lo:13: Request processed in 85us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603839.961666:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787603839.961720:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2c1b1d880 x1874438355176320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603839.961738:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355176320:0@lo:13: 00000100:00080000:2.0:1787603839.961773:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1787603839.961819:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787603839.961823:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ed286a76000 from 30 10000000:01000000:0.0:1787603839.961827:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787603839.961868:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.961877:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.961910:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603839.961926:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355176448:0@lo:101: 00000100:00100000:0.0:1787603839.961957:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603839.961988:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28b66e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603839.962046:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355176448 00000100:00100000:2.0:1787603839.962051:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355176448 00000100:00100000:2.0:1787603839.962087:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787603839.962095:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355176448:12345-0@lo:101: 00010000:00010000:2.0:1787603839.962110:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603839.962121:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a1901366 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190135f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.962143:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a1901366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190135f expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.962153:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a1901366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190135f expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.962162:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217ce00, rc 0) 00000100:00100000:2.0:1787603839.962195:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355176448:12345-0@lo:101: Request processed in 102us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603839.962201:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787603839.962233:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355176448:0@lo:101: 00010000:00010000:2.0:1787603839.962246:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901366 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.962255:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901366 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603839.962321:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355176576:0@lo:501: 00000100:00100000:2.0:1787603839.962360:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603839.962381:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787603839.962392:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355176576 00000100:00100000:2.0:1787603839.962395:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355176576 00000100:00100000:2.0:1787603839.962416:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787603839.962423:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355176576:12345-0@lo:501: 00000100:00100000:2.0:1787603839.962668:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355176576:12345-0@lo:501: Request processed in 245us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603839.962675:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787603839.962703:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355176576:0@lo:501: 00000100:00100000:2.0:1787603839.962729:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355176704:0@lo:503: 00000100:00100000:2.0:1787603839.962764:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603839.962786:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28713b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787603839.962996:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355176704 00000100:00100000:0.0:1787603839.963001:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355176704 00000100:00100000:0.0:1787603839.963033:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787603839.963039:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355176704:12345-0@lo:503: 00000100:00100000:0.0:1787603839.963199:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355176704:12345-0@lo:503: Request processed in 159us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603839.963205:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787603839.964704:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355176704:0@lo:503: 00000100:00100000:1.0:1787603839.965239:0:8076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8076:1874438355176832:0@lo:502: 00000100:00100000:1.0:1787603839.965322:0:8076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603839.965371:0:8076:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7000 going to sleep for 11 seconds 00000100:00100000:0.0:1787603839.965532:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355176832 00000100:00100000:0.0:1787603839.965538:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355176832 00000100:00100000:0.0:1787603839.965584:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787603839.965594:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:8076:x1874438355176832:12345-0@lo:502: 00000100:00100000:0.0:1787603839.965888:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:8076:x1874438355176832:12345-0@lo:502: Request processed in 295us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603839.965907:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787603839.966446:0:8076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8076:1874438355176832:0@lo:502: 00000100:00100000:1.0:1787603839.966503:0:8076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8076:1874438355176960:0@lo:502: 00000100:00100000:1.0:1787603839.966542:0:8076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603839.966578:0:8076:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed285c1b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603839.966644:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355176960 00000100:00100000:2.0:1787603839.966649:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355176960 00000100:00100000:2.0:1787603839.966687:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787603839.966696:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:8076:x1874438355176960:12345-0@lo:502: 00000100:00100000:2.0:1787603839.966910:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:8076:x1874438355176960:12345-0@lo:502: Request processed in 203us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603839.966918:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787603839.967215:0:8076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8076:1874438355176960:0@lo:502: 00000040:00080000:1.0:1787603839.967236:0:8076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787603839.967579:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787603839.967599:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787603839.967610:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901366 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603839.967631:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901366 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603839.967642:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787603839.967644:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787603839.967647:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787603839.967675:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603839.967683:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603839.967692:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603839.967705:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355177088:0@lo:101: 00000100:00100000:3.0:1787603839.967742:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603839.967779:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787603839.967866:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355177088 00000100:00100000:0.0:1787603839.967871:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355177088 00000100:00100000:0.0:1787603839.967908:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787603839.967916:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355177088:12345-0@lo:101: 00010000:00010000:0.0:1787603839.967927:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603839.967940:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a1901374 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190136d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.967971:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a1901374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190136d expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.967980:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a1901374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190136d expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.967988:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed280031a00, rc 0) 00000100:00100000:0.0:1787603839.968020:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355177088:12345-0@lo:101: Request processed in 105us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603839.968026:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787603839.968209:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355177088:0@lo:101: 00010000:00010000:3.0:1787603839.968222:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901374 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603839.968231:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901374 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603839.968274:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355177216:0@lo:501: 00000100:00100000:3.0:1787603839.968313:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603839.968447:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355177216 00000100:00100000:0.0:1787603839.968452:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355177216 00000100:00100000:0.0:1787603839.968480:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787603839.968487:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355177216:12345-0@lo:501: 00000100:00100000:0.0:1787603839.971992:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355177216:12345-0@lo:501: Request processed in 3495us (3668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603839.972008:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787603839.972365:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787603839.972392:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355177216:0@lo:501: 00000100:00100000:3.0:1787603839.972447:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355177344:0@lo:503: 00000100:00100000:3.0:1787603839.972503:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603839.972530:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787603839.972995:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355177344 00000100:00100000:1.0:1787603839.973003:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355177344 00000100:00100000:1.0:1787603839.973042:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787603839.973050:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355177344:12345-0@lo:503: 00000100:00100000:1.0:1787603839.973346:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355177344:12345-0@lo:503: Request processed in 288us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603839.973354:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787603839.973657:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355177344:0@lo:503: 00000100:00100000:3.0:1787603839.975080:0:8077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8077:1874438355177472:0@lo:502: 00000100:00100000:3.0:1787603839.975155:0:8077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603839.975197:0:8077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603839.975247:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355177472 00000100:00100000:1.0:1787603839.975253:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355177472 00000100:00100000:1.0:1787603839.975304:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787603839.975313:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+15:8077:x1874438355177472:12345-0@lo:502: 00000100:00100000:1.0:1787603839.975621:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+15:8077:x1874438355177472:12345-0@lo:502: Request processed in 308us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603839.975629:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787603839.976477:0:8077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8077:1874438355177472:0@lo:502: 00000020:01000000:0.0:1787603839.976514:0:8077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787603839.976524:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787603839.976527:0:8077:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787603839.976532:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787603839.976534:0:8077:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787603839.976556:0:8077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8077:1874438355177600:0@lo:502: 00000100:00100000:0.0:1787603839.976609:0:8077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603839.976761:0:8077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28b66ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787603839.976893:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355177600 00000100:00100000:1.0:1787603839.976910:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355177600 00000100:00100000:1.0:1787603839.976990:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787603839.976999:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:8077:x1874438355177600:12345-0@lo:502: 00000100:00100000:1.0:1787603839.977208:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:8077:x1874438355177600:12345-0@lo:502: Request processed in 208us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603839.977215:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787603839.977306:0:8077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8077:1874438355177600:0@lo:502: 00000020:01000000:3.0:1787603839.977328:0:8077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603839.977334:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603839.977347:0:8077:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787603839.977352:0:8077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1787603839.977518:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787603839.977537:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787603839.977547:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901374 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.977557:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901374 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787603839.977566:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787603839.977568:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ed29010d000 from 30 10000000:01000000:2.0:1787603839.977570:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787603839.977594:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.977606:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.977615:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603839.977627:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355177728:0@lo:101: 00000100:00100000:2.0:1787603839.977660:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603839.978512:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28713ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787603839.978571:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355177728 00000100:00100000:0.0:1787603839.978587:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355177728 00000100:00100000:3.0:1787603839.978892:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787603839.978913:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355177728:12345-0@lo:101: 00010000:00010000:3.0:1787603839.978926:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603839.978943:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a1901382 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190137b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603839.978968:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a1901382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190137b expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603839.978978:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a1901382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190137b expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603839.978985:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5daca00, rc 0) 00000100:00100000:3.0:1787603839.979048:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355177728:12345-0@lo:101: Request processed in 136us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603839.979055:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787603839.979206:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355177728:0@lo:101: 00010000:00010000:2.0:1787603839.979221:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901382 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.979230:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901382 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603839.979296:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355177856:0@lo:501: 00000100:00100000:2.0:1787603839.979326:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603839.979361:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28713ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787603839.979520:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355177856 00000100:00100000:3.0:1787603839.979525:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355177856 00000100:00100000:3.0:1787603839.979548:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787603839.979555:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355177856:12345-0@lo:501: 00000100:00100000:3.0:1787603839.979942:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355177856:12345-0@lo:501: Request processed in 387us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603839.979950:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787603839.980018:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355177856:0@lo:501: 00000100:00100000:2.0:1787603839.980048:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355177984:0@lo:503: 00000100:00100000:2.0:1787603839.980099:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603839.980128:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28713ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787603839.980233:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355177984 00000100:00100000:3.0:1787603839.980238:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355177984 00000100:00100000:3.0:1787603839.980258:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787603839.980264:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355177984:12345-0@lo:503: 00000100:00100000:3.0:1787603839.980426:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355177984:12345-0@lo:503: Request processed in 162us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603839.980433:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787603839.980600:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355177984:0@lo:503: 00000100:00100000:2.0:1787603839.981528:0:8078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8078:1874438355178112:0@lo:502: 00000100:00100000:2.0:1787603839.981593:0:8078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603839.981662:0:8078:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28713ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787603839.981810:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355178112 00000100:00100000:1.0:1787603839.981816:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355178112 00000100:00100000:1.0:1787603839.982013:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787603839.982024:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+16:8078:x1874438355178112:12345-0@lo:502: 00000100:00100000:1.0:1787603839.982261:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+16:8078:x1874438355178112:12345-0@lo:502: Request processed in 239us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603839.982268:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787603839.982478:0:8078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8078:1874438355178112:0@lo:502: 00000100:00100000:2.0:1787603839.982526:0:8078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8078:1874438355178240:0@lo:502: 00000100:00100000:2.0:1787603839.982561:0:8078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603839.982824:0:8078:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787603839.983019:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355178240 00000100:00100000:0.0:1787603839.983025:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355178240 00000100:00100000:0.0:1787603839.983053:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787603839.983069:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+16:8078:x1874438355178240:12345-0@lo:502: 00000100:00100000:0.0:1787603839.983251:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+16:8078:x1874438355178240:12345-0@lo:502: Request processed in 190us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603839.983258:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787603839.983390:0:8078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8078:1874438355178240:0@lo:502: 00000040:00080000:2.0:1787603839.983412:0:8078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787603839.983618:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787603839.983636:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787603839.983646:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901382 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.983657:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901382 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603839.983666:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787603839.983669:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ed29010d000 from 5 10000000:01000000:0.0:1787603839.983671:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787603839.983714:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.983722:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.983731:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603839.983744:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355178368:0@lo:101: 00000100:00100000:0.0:1787603839.983775:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603839.983864:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28b66e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603839.984041:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355178368 00000100:00100000:1.0:1787603839.984046:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355178368 00000100:00100000:2.0:1787603839.984149:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787603839.984157:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355178368:12345-0@lo:101: 00010000:00010000:2.0:1787603839.984166:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603839.984178:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217d000/0xb5d1f3b1a1901390 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901389 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.984198:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217d000/0xb5d1f3b1a1901390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901389 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.984207:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217d000/0xb5d1f3b1a1901390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901389 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.984215:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217d000, rc 0) 00000100:00100000:2.0:1787603839.984241:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355178368:12345-0@lo:101: Request processed in 86us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603839.984247:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787603839.984385:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355178368:0@lo:101: 00010000:00010000:0.0:1787603839.984398:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.984406:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603839.984451:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355178496:0@lo:256: 00000100:00100000:0.0:1787603839.984482:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603839.984511:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28b66e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603839.984558:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355178496 00000100:00100000:2.0:1787603839.984566:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355178496 00000100:00100000:2.0:1787603839.984583:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787603839.984595:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355178496:12345-0@lo:256: 20000000:01000000:2.0:1787603839.984608:0:5815:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787603839.984623:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787603839.984626:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787603839.984793:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355178496:12345-0@lo:256: Request processed in 198us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603839.984800:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787603839.984870:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355178496:0@lo:256: 10000000:01000000:0.0:1787603839.984919:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787603839.984925:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.984933:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603839.984939:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787603839.984941:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787603839.984944:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787603839.984960:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.984967:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.984974:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603839.984990:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355178624:0@lo:101: 00000100:00100000:0.0:1787603839.985010:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603839.985029:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed287f30480 going to sleep for 11 seconds 00000100:00100000:2.0:1787603839.987877:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355178624 00000100:00100000:2.0:1787603839.987892:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355178624 00000100:00100000:2.0:1787603839.987956:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787603839.987967:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355178624:12345-0@lo:101: 00010000:00010000:2.0:1787603839.987985:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603839.988001:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a190139e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901397 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.988030:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a190139e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901397 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.988041:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a190139e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901397 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603839.988050:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217cc00, rc 0) 00000100:00100000:2.0:1787603839.988142:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355178624:12345-0@lo:101: Request processed in 177us (3130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603839.988149:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787603839.989207:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355178624:0@lo:101: 00010000:00010000:0.0:1787603839.989227:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190139e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603839.989237:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190139e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603839.989317:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355178752:0@lo:501: 00000100:00100000:0.0:1787603839.989367:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603839.989408:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed287f30480 going to sleep for 11 seconds 00000100:00100000:2.0:1787603839.989812:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355178752 00000100:00100000:2.0:1787603839.989820:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355178752 00000100:00100000:2.0:1787603839.989879:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787603839.989891:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355178752:12345-0@lo:501: 00000100:00100000:2.0:1787603839.990529:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355178752:12345-0@lo:501: Request processed in 639us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603839.990539:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787603839.993774:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355178752:0@lo:501: 00000100:00100000:3.0:1787603839.994037:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355178880:0@lo:503: 00000100:00100000:3.0:1787603839.994220:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603839.994265:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787603839.994385:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355178880 00000100:00100000:0.0:1787603839.994392:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355178880 00000100:00100000:0.0:1787603839.994442:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787603839.994452:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355178880:12345-0@lo:503: 00000100:00100000:0.0:1787603839.994703:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355178880:12345-0@lo:503: Request processed in 251us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603839.994711:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787603839.995054:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355178880:0@lo:503: 00000100:00100000:0.0:1787603839.995766:0:8079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8079:1874438355179008:0@lo:502: 00000100:00100000:0.0:1787603839.995818:0:8079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603839.995931:0:8079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28b66e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603840.007221:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355179008 00000100:00100000:2.0:1787603840.007238:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355179008 00000100:00100000:2.0:1787603840.007948:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787603840.007968:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:8079:x1874438355179008:12345-0@lo:502: 00000100:00100000:2.0:1787603840.009424:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:8079:x1874438355179008:12345-0@lo:502: Request processed in 1455us (13597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603840.009436:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787603840.011687:0:8079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8079:1874438355179008:0@lo:502: 00000020:01000000:0.0:1787603840.011740:0:8079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787603840.011760:0:8079:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787603840.011768:0:8079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787603840.011770:0:8079:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787603840.011776:0:8079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787603840.011780:0:8079:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.121@tcp to nid 0x20000c0a8ca79 (192.168.202.121@tcp) 00000020:01000000:0.0:1787603840.011805:0:8079:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787603840.011809:0:8079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787603840.011894:0:8079:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ed2b6134d28) 00000020:00000080:0.0:1787603840.011930:0:8079:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787603840.011938:0:8079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787603840.012028:0:8079:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787603840.012035:0:8079:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787603840.012042:0:8079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a19013ac 00010000:00080000:0.0:1787603840.012091:0:8079:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ed2c11c4800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.121@tcp at head 00010000:00010000:0.0:1787603840.013676:0:8079:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787603840.014293:0:8079:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787603840.014317:0:8079:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787603840.016254:0:8079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787603840.016735:0:8079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787603840.016786:0:8079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787603840.017025:0:8079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787603840.017729:0:8080:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787603840.017735:0:8080:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787603840.019044:0:8079:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787603840.019058:0:8079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787603840.019165:0:8079:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787603840.019189:0:8079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb5d1f3b1a19013b3 00000100:00080000:0.0:1787603840.019199:0:8079:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787603840.019205:0:8079:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ed2c11c4800 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:0.0:1787603840.019239:0:8079:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2c1b1e680 x1874438355179136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787603840.019295:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355179136:0@lo:8: 00000100:00100000:2.0:1787603840.019478:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787603840.019679:0:8079:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787603840.019745:0:8079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787603840.019749:0:8079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787603840.019751:0:8079:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787603840.019754:0:8079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787603840.019758:0:8079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787603840.019759:0:8079:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787603840.019762:0:8079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787603840.019764:0:8079:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787603840.019789:0:8079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8079:1874438355179264:0@lo:502: 00000100:00100000:0.0:1787603840.019832:0:8079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603840.019870:0:8079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787603840.019983:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355179392:0@lo:400: 00000100:00100000:1.0:1787603840.020014:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603840.020036:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787603840.020041:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355179520:0@lo:400: 00000100:00100000:1.0:1787603840.020073:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603840.020114:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355179648:0@lo:400: 00000100:00100000:1.0:1787603840.020137:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603840.020170:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355179392 00000100:00100000:1.0:1787603840.020176:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355179392 00000100:00100000:1.0:1787603840.020212:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355179520 00000100:00100000:1.0:1787603840.020215:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355179520 00000100:00100000:1.0:1787603840.020236:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355179648 00000100:00100000:1.0:1787603840.020239:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355179648 00000100:00100000:1.0:1787603840.020253:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787603840.020261:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355179392:12345-0@lo:400: 00000100:00100000:1.0:1787603840.020609:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355179392:12345-0@lo:400: Request processed in 347us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603840.020616:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787603840.020634:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787603840.020640:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355179520:12345-0@lo:400: 00000100:00100000:1.0:1787603840.020663:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355179520:12345-0@lo:400: Request processed in 23us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603840.020668:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787603840.020677:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787603840.020682:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355179648:12345-0@lo:400: 00000100:00100000:1.0:1787603840.020708:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355179648:12345-0@lo:400: Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603840.020714:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787603840.020736:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787603840.020763:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b606f100 x1874438355179648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603840.020776:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355179648:0@lo:400: 00010000:00080000:1.0:1787603840.020813:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b606dc00 x1874438355179520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603840.020823:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355179520:0@lo:400: 00010000:00080000:1.0:1787603840.020832:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b606fb80 x1874438355179392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603840.020865:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355179392:0@lo:400: 00000100:00100000:1.0:1787603840.020885:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355179264 00000100:00100000:1.0:1787603840.020889:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355179264 00000100:00100000:1.0:1787603840.020924:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787603840.020930:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:8079:x1874438355179264:12345-0@lo:502: 00000100:00100000:1.0:1787603840.021147:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:8079:x1874438355179264:12345-0@lo:502: Request processed in 217us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603840.021154:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787603840.021316:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355179136 00000100:00100000:3.0:1787603840.021320:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355179136 00000100:00100000:3.0:1787603840.021353:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787603840.021358:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874438355179136:12345-0@lo:8: 00010000:00080000:3.0:1787603840.021379:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:3.0:1787603840.021405:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb5d1f3b1a19013ba 00002000:00100000:3.0:1787603840.021418:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ed2c1c8d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787603840.021422:0:6676:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1787603840.021425:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787603840.021545:0:6676:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787603840.021697:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787603840.021721:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9ed2c1c8c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787603840.022766:0:8079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8079:1874438355179264:0@lo:502: 00000020:01000000:0.0:1787603840.022854:0:8079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787603840.022866:0:8079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787603840.022868:0:8079:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787603840.022873:0:8079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787603840.022953:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787603840.022974:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787603840.022987:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190139e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603840.022998:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190139e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603840.023010:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787603840.023013:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ed28654cd28 from 1 10000000:01000000:0.0:1787603840.023016:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787603840.023054:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603840.023075:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603840.023095:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603840.023115:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355179776:0@lo:101: 00000100:00100000:0.0:1787603840.023175:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603840.023215:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787603840.023817:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1874438355179136:12345-0@lo:8: Request processed in 2454us (4336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603840.023829:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787603840.024136:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2c1b1e680 x1874438355179136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787603850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603840.024148:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787603840.024157:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787603840.024166:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787603840.024172:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787603840.024175:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2c11c4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787603840.024230:0:3280:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787603840.024236:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355179136:0@lo:8: 00000100:00100000:2.0:1787603840.024266:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355179776 00000100:00100000:2.0:1787603840.024272:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355179776 00000100:00100000:2.0:1787603840.024333:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787603840.024473:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355179776:12345-0@lo:101: 00010000:00010000:2.0:1787603840.024485:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603840.024509:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217ca00/0xb5d1f3b1a19013c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19013c1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603840.024546:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217ca00/0xb5d1f3b1a19013c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19013c1 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603840.024556:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217ca00/0xb5d1f3b1a19013c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19013c1 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603840.024566:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217ca00, rc 0) 00000100:00100000:2.0:1787603840.024612:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355179776:12345-0@lo:101: Request processed in 142us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603840.024618:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787603840.024810:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355179776:0@lo:101: 00010000:00010000:0.0:1787603840.024826:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19013c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603840.024860:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19013c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603840.024957:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355179904:0@lo:501: 00000100:00100000:0.0:1787603840.024987:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603840.025016:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787603840.025029:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355179904 00000100:00100000:0.0:1787603840.025032:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355179904 00000100:00100000:0.0:1787603840.025052:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787603840.025059:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355179904:12345-0@lo:501: 00000100:00100000:0.0:1787603840.025270:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355179904:12345-0@lo:501: Request processed in 210us (282us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787603840.025286:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787603840.025327:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355179904:0@lo:501: 10000000:01000000:0.0:1787603840.025458:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787603840.025465:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19013c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603840.025479:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19013c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787603840.025706:0:8080:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787603840.025810:0:8080:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 173089971821ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787603840.090223:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787603840.154385:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787603840.154415:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355180032:0@lo:13: 00000100:00100000:2.0:1787603840.154497:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603840.154569:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355180032 00000100:00100000:2.0:1787603840.154577:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355180032 00000100:00100000:2.0:1787603840.154634:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787603840.154658:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874438355180032:12345-0@lo:13: 00002000:00000024:2.0:1787603840.154939:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787603840.154994:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874438355180032:12345-0@lo:13: Request processed in 337us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603840.155001:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787603840.155023:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787603840.155051:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d52d80 x1874438355180032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603840.155073:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355180032:0@lo:13: 00000004:00080000:2.0:1787603840.155091:0:8081:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787603840.155125:0:8081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d52d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8081:1874438355180160:0@lo:7: 00000100:00100000:2.0:1787603840.155151:0:8081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603840.155173:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355180160 00000100:00100000:2.0:1787603840.155176:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355180160 00000100:00100000:2.0:1787603840.155200:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787603840.155206:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8081:x1874438355180160:12345-0@lo:7: 00000100:00100000:0.0:1787603840.158041:0:8081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf069300 going to sleep for 11 seconds 00002000:00080000:2.0:1787603840.189928:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787603840.189937:0:6678:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787603840.190048:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8081:x1874438355180160:12345-0@lo:7: Request processed in 34835us (34889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603840.190061:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787603840.190549:0:8081:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d52d80 x1874438355180160/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787603856 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603840.190566:0:8081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d52d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8081:1874438355180160:0@lo:7: 00000004:00080000:0.0:1787603840.190581:0:8081:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787603840.190619:0:8081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8081:1874438355180288:0@lo:5: 00000100:00100000:0.0:1787603840.190651:0:8081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603840.190722:0:8081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787603840.191791:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355180288 00000100:00100000:1.0:1787603840.191801:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355180288 00000100:00100000:1.0:1787603840.191885:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787603840.191904:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8081:x1874438355180288:12345-0@lo:5: 00002000:00080000:1.0:1787603840.191934:0:6676:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787603840.191939:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787603840.192262:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8081:x1874438355180288:12345-0@lo:5: Request processed in 366us (1607us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787603840.192269:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787603840.194102:0:8081:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2c1b1ea00 x1874438355180288/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787603856 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603840.194122:0:8081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8081:1874438355180288:0@lo:5: 00000004:00080000:2.0:1787603840.194137:0:8081:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787603840.194181:0:8081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d51180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8081:1874438355180416:0@lo:700: 00000100:00100000:2.0:1787603840.194233:0:8081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603840.195983:0:8081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed290c446c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787603840.201482:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355180416 00000100:00100000:0.0:1787603840.201499:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355180416 00000100:00100000:0.0:1787603840.202859:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787603840.202873:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8081:x1874438355180416:12345-0@lo:700: 00000100:00100000:0.0:1787603840.202945:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1874438355180544:0@lo:700: 00000100:00100000:0.0:1787603840.203020:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603840.203068:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787603840.205379:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355180544 00000100:00100000:3.0:1787603840.205395:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355180544 00000100:00100000:3.0:1787603840.205468:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787603840.205480:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1874438355180544:12345-0@lo:700: 40000000:02000000:3.0:1787603840.316304:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787603840.343525:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1874438355180544:12345-0@lo:700: Request processed in 138039us (140497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603840.343538:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787603840.344017:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2c1b1ce00 x1874438355180544/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787603856 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603840.344033:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1874438355180544:0@lo:700: 40000000:02000000:3.0:1787603840.344047:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:1.0:1787603840.370408:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603840.502434:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8081:x1874438355180416:12345-0@lo:700: Request processed in 299548us (308184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603840.502456:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787603840.502588:0:8081:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d51180 x1874438355180416/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787603856 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000001:00080000:2.0:1787603840.502692:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1787603840.502714:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787603840.503189:0:8081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d51180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8081:1874438355180416:0@lo:700: 00000004:02000040:2.0:1787603840.569561:0:8081:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787603840.578356:0:8081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8081:1874438355180672:0@lo:5: 00000100:00100000:3.0:1787603840.579776:0:8081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603840.579866:0:8081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed284e39300 going to sleep for 11 seconds 00000100:00100000:1.0:1787603840.579937:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355180672 00000100:00100000:1.0:1787603840.579944:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355180672 00000100:00100000:1.0:1787603840.579991:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787603840.579999:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8081:x1874438355180672:12345-0@lo:5: 00002000:00080000:1.0:1787603840.591077:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787603840.591097:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787603840.603834:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8081:x1874438355180672:12345-0@lo:5: Request processed in 23829us (24053us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787603840.603867:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787603840.603941:0:8081:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed290176a00 x1874438355180672/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787603856 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603840.603954:0:8081:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787603840.603968:0:8081:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed290176a00 x1874438355180672/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787603856 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603840.603979:0:8081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8081:1874438355180672:0@lo:5: 00000004:00080000:1.0:1787603840.603994:0:8081:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787603841.433136:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603842.455167:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787603842.492685:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787603843.479655:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603844.074504:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603844.076128:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345720192 00000100:00100000:0.0:1787603844.076143:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345720192 00000100:00100000:0.0:1787603844.076203:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 111 00000100:00100000:0.0:1787603844.076212:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2362:x1874438345720192:12345-192.168.202.21@tcp:250: 00010000:00080000:0.0:1787603844.076240:0:5816:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f844a97d-1878-4049-bbc8-d860aeb2443e@192.168.202.21@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1787603844.076277:0:5816:0:(genops.c:1385:class_connect()) connect: client f844a97d-1878-4049-bbc8-d860aeb2443e, cookie 0xb5d1f3b1a19013cf 00000100:00080000:0.0:1787603844.076422:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9ed285c16800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787603844.076799:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+5:2362:x1874438345720192:12345-192.168.202.21@tcp:250: Request processed in 585us (2303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603844.076808:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 111 00000100:00100000:3.0:1787603844.084986:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603844.085081:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345720064 00000100:00100000:2.0:1787603844.085091:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345720064 00000100:00100000:2.0:1787603844.085146:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 112 00000100:00100000:2.0:1787603844.085156:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+5:5594:x1874438345720064:12345-192.168.202.21@tcp:101: 00010000:00010000:2.0:1787603844.085171:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603844.085200:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19013d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e58c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603844.085229:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19013d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58c9 expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603844.085240:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19013d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58c9 expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603844.085249:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217c400, rc 0) 00000100:00100000:2.0:1787603844.085354:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+6:5594:x1874438345720064:12345-192.168.202.21@tcp:101: Request processed in 198us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603844.085361:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 112 00000100:00100000:1.0:1787603844.093659:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603844.093787:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345720320 00000100:00100000:2.0:1787603844.093797:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345720320 00000100:00100000:2.0:1787603844.093892:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 113 00000100:00100000:2.0:1787603844.093903:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+6:5594:x1874438345720320:12345-192.168.202.21@tcp:501: 00000100:00100000:2.0:1787603844.094256:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+6:5594:x1874438345720320:12345-192.168.202.21@tcp:501: Request processed in 353us (607us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787603844.094265:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 113 00000100:00100000:3.0:1787603844.098939:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603844.101381:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345720448 00000100:00100000:0.0:1787603844.101395:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345720448 00000100:00100000:0.0:1787603844.101463:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 114 00000100:00100000:0.0:1787603844.101475:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+6:5594:x1874438345720448:12345-192.168.202.21@tcp:101: 00010000:00010000:0.0:1787603844.101492:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603844.101510:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed280030200/0xb5d1f3b1a19013dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e58d0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603844.101541:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed280030200/0xb5d1f3b1a19013dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58d0 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603844.101552:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed280030200/0xb5d1f3b1a19013dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58d0 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603844.101561:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed280030200, rc 0) 00000100:00100000:0.0:1787603844.101956:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+7:5594:x1874438345720448:12345-192.168.202.21@tcp:101: Request processed in 481us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603844.101964:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 114 00000100:00100000:3.0:1787603844.118672:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603844.119108:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345720576 00000100:00100000:0.0:1787603844.119120:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345720576 00000100:00100000:0.0:1787603844.119183:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 115 00000100:00100000:0.0:1787603844.119194:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+7:5594:x1874438345720576:12345-192.168.202.21@tcp:501: 00000100:00100000:0.0:1787603844.119515:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+8:5594:x1874438345720576:12345-192.168.202.21@tcp:501: Request processed in 322us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603844.119524:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 115 00000100:00100000:1.0:1787603844.141242:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603844.141338:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345720704 00000100:00100000:2.0:1787603844.141349:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345720704 00000100:00100000:2.0:1787603844.141466:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 116 00000100:00100000:2.0:1787603844.141478:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+8:5594:x1874438345720704:12345-192.168.202.21@tcp:503: 00000100:00100000:2.0:1787603844.141908:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+8:5594:x1874438345720704:12345-192.168.202.21@tcp:503: Request processed in 431us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603844.141916:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 116 00000100:00100000:3.0:1787603844.145579:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603844.145899:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345720832 00000100:00100000:1.0:1787603844.145911:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345720832 00000100:00100000:1.0:1787603844.145970:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 117 00000100:00100000:1.0:1787603844.145980:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+8:5612:x1874438345720832:12345-192.168.202.21@tcp:502: 00000100:00100000:1.0:1787603844.146349:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+8:5612:x1874438345720832:12345-192.168.202.21@tcp:502: Request processed in 369us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603844.146364:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 117 00000100:00100000:3.0:1787603844.207908:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603844.208027:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345720960 00000100:00100000:2.0:1787603844.208051:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345720960 00000100:00100000:2.0:1787603844.208118:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 118 00000100:00100000:2.0:1787603844.208136:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+8:5612:x1874438345720960:12345-192.168.202.21@tcp:502: 00000100:00100000:2.0:1787603844.208407:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+8:5612:x1874438345720960:12345-192.168.202.21@tcp:502: Request processed in 280us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603844.208416:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 118 00000100:00100000:2.0:1787603844.240173:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603844.240288:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345721088 00000100:00100000:1.0:1787603844.240299:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345721088 00000100:00100000:1.0:1787603844.240359:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 119 00000100:00100000:1.0:1787603844.240370:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+8:5594:x1874438345721088:12345-192.168.202.21@tcp:101: 00010000:00010000:1.0:1787603844.240387:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603844.240404:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2813a0800/0xb5d1f3b1a19013e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e58fa expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603844.240434:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2813a0800/0xb5d1f3b1a19013e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58fa expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603844.240445:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2813a0800/0xb5d1f3b1a19013e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58fa expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603844.240454:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2813a0800, rc 0) 00000100:00100000:1.0:1787603844.240531:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+9:5594:x1874438345721088:12345-192.168.202.21@tcp:101: Request processed in 162us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603844.240538:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 119 00000100:00100000:3.0:1787603844.244531:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603844.244887:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345721216 00000100:00100000:1.0:1787603844.244897:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345721216 00000100:00100000:1.0:1787603844.244958:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 120 00000100:00100000:1.0:1787603844.244969:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+9:5594:x1874438345721216:12345-192.168.202.21@tcp:256: 20000000:01000000:1.0:1787603844.244996:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787603844.245022:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787603844.245026:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787603844.245029:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787603844.245036:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787603844.248916:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+9:5594:x1874438345721216:12345-192.168.202.21@tcp:256: Request processed in 3938us (4384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603844.248931:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 120 00000100:00100000:2.0:1787603844.253531:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603844.254124:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345721344 00000100:00100000:1.0:1787603844.254135:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345721344 00000100:00100000:1.0:1787603844.254245:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 121 00000100:00100000:1.0:1787603844.254256:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+9:5594:x1874438345721344:12345-192.168.202.21@tcp:101: 00010000:00010000:1.0:1787603844.254274:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603844.254292:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2813a1200/0xb5d1f3b1a19013eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5901 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603844.254321:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2813a1200/0xb5d1f3b1a19013eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5901 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603844.254333:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2813a1200/0xb5d1f3b1a19013eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5901 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603844.254343:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2813a1200, rc 0) 00000100:00100000:1.0:1787603844.254406:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5594:x1874438345721344:12345-192.168.202.21@tcp:101: Request processed in 152us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603844.254414:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 121 00000100:00100000:3.0:1787603844.257410:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603844.264390:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345721472 00000100:00100000:0.0:1787603844.264405:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345721472 00000100:00100000:0.0:1787603844.264472:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 122 00000100:00100000:0.0:1787603844.264482:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5594:x1874438345721472:12345-192.168.202.21@tcp:501: 00000100:00100000:0.0:1787603844.264787:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5594:x1874438345721472:12345-192.168.202.21@tcp:501: Request processed in 305us (7392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603844.264796:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 122 00000100:00100000:3.0:1787603844.268339:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603844.269110:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345721600 00000100:00100000:0.0:1787603844.269129:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345721600 00000100:00100000:0.0:1787603844.269186:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 123 00000100:00100000:0.0:1787603844.269196:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5594:x1874438345721600:12345-192.168.202.21@tcp:503: 00000100:00100000:0.0:1787603844.269605:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5594:x1874438345721600:12345-192.168.202.21@tcp:503: Request processed in 409us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603844.269615:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 123 00000100:00100000:3.0:1787603844.274833:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603844.274975:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345721728 00000100:00100000:0.0:1787603844.274990:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345721728 00000100:00100000:0.0:1787603844.275059:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 124 00000100:00100000:0.0:1787603844.275070:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5618:x1874438345721728:12345-192.168.202.21@tcp:502: 00000100:00100000:0.0:1787603844.275329:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5618:x1874438345721728:12345-192.168.202.21@tcp:502: Request processed in 260us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603844.275336:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 124 00000100:00100000:3.0:1787603844.281109:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603844.281225:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345721856 00000100:00100000:2.0:1787603844.281245:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345721856 00000100:00100000:2.0:1787603844.281323:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 125 00000100:00100000:2.0:1787603844.281335:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5618:x1874438345721856:12345-192.168.202.21@tcp:502: 00000100:00100000:2.0:1787603844.282031:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5618:x1874438345721856:12345-192.168.202.21@tcp:502: Request processed in 695us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603844.282040:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 125 00000100:00100000:3.0:1787603844.287988:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603844.292787:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345721984 00000100:00100000:1.0:1787603844.292805:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345721984 00000100:00100000:0.0:1787603844.292949:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:0.0:1787603844.292970:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2362:x1874438345721984:12345-192.168.202.21@tcp:38: 00010000:00080000:0.0:1787603844.292999:0:5821:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1787603844.293048:0:5821:0:(genops.c:1385:class_connect()) connect: client a45d6158-dc8e-48e6-b534-483bf3fa20ad, cookie 0xb5d1f3b1a19013f2 00000004:00100000:0.0:1787603844.293078:0:5821:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:0.0:1787603844.293084:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787603844.338353:0:5821:0:(import.c:65:import_set_state_nolock()) ffff9ed1835b9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787603844.338457:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2362:x1874438345721984:12345-192.168.202.21@tcp:38: Request processed in 45485us (50476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603844.338480:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4 00010000:00010000:1.0:1787603844.503359:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603844.847483:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603844.847538:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603844.847640:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345722112 00000100:00100000:1.0:1787603844.847650:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345722112 00000100:00100000:1.0:1787603844.847726:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345722240 00000100:00100000:1.0:1787603844.847729:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345722240 00000100:00100000:1.0:1787603844.847767:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:1.0:1787603844.847777:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:0:x1874438345722112:12345-192.168.202.21@tcp:41: 00000004:00000024:1.0:1787603844.847819:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787603844.847924:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:0:x1874438345722112:12345-192.168.202.21@tcp:41: Request processed in 148us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603844.847931:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:1.0:1787603844.847949:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:1.0:1787603844.847955:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:5594:x1874438345722240:12345-192.168.202.21@tcp:41: 00000004:00000024:1.0:1787603844.847964:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787603844.847981:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:5594:x1874438345722240:12345-192.168.202.21@tcp:41: Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603844.847999:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00080000:2.0:1787603844.848072:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603844.851915:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603844.852049:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345722368 00000100:00100000:1.0:1787603844.852060:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345722368 00000100:00100000:1.0:1787603844.852256:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:1.0:1787603844.852267:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:5594:x1874438345722368:12345-192.168.202.21@tcp:40: 00000100:00100000:1.0:1787603844.852352:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:5594:x1874438345722368:12345-192.168.202.21@tcp:40: Request processed in 86us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603844.852360:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:3.0:1787603844.858343:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603844.858391:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603844.858445:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603844.858491:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603844.858639:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345722496 00000100:00100000:0.0:1787603844.858650:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345722496 00000100:00100000:0.0:1787603844.858693:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345722624 00000100:00100000:0.0:1787603844.858696:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345722624 00000100:00100000:0.0:1787603844.858711:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:0.0:1787603844.858720:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874438345722496:12345-192.168.202.21@tcp:8: 00010000:00080000:0.0:1787603844.858751:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1787603844.858783:0:6679:0:(genops.c:1385:class_connect()) connect: client a45d6158-dc8e-48e6-b534-483bf3fa20ad, cookie 0xb5d1f3b1a19013f9 00002000:00100000:0.0:1787603844.858795:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a45d6158-dc8e-48e6-b534-483bf3fa20ad/ffff9ed285c13800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787603844.858818:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787603844.859181:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787603844.859209:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9ed285c13000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787603844.859277:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2362:x1874438345722496:12345-192.168.202.21@tcp:8: Request processed in 556us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603844.859286:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:0.0:1787603844.859302:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:0.0:1787603844.859307:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874438345722624:12345-192.168.202.21@tcp:8: 00010000:00080000:0.0:1787603844.859321:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1787603844.859338:0:6679:0:(genops.c:1385:class_connect()) connect: client a45d6158-dc8e-48e6-b534-483bf3fa20ad, cookie 0xb5d1f3b1a1901400 00002000:00100000:0.0:1787603844.859343:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a45d6158-dc8e-48e6-b534-483bf3fa20ad/ffff9ed285c16000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787603844.859365:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787603844.859553:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787603844.859568:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9ed285c17000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787603844.859592:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2362:x1874438345722624:12345-192.168.202.21@tcp:8: Request processed in 283us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603844.859599:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:2.0:1787603844.859904:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345722752 00000100:00100000:2.0:1787603844.859911:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345722752 00000100:00100000:2.0:1787603844.859951:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:2.0:1787603844.859959:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:5594:x1874438345722752:12345-192.168.202.21@tcp:33: 00000100:00100000:1.0:1787603844.861325:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345722880 00000100:00100000:1.0:1787603844.861334:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345722880 00000100:00100000:1.0:1787603844.861382:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 126 00000100:00100000:1.0:1787603844.861391:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2366:x1874438345722880:12345-192.168.202.21@tcp:400: 00000100:00100000:1.0:1787603844.861443:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2366:x1874438345722880:12345-192.168.202.21@tcp:400: Request processed in 53us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603844.861460:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 126 00000004:00080000:2.0:1787603844.880304:0:5824:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 20288us 00000004:00200000:1.0:1787603844.897981:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787603844.898162:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:5594:x1874438345722752:12345-192.168.202.21@tcp:33: Request processed in 38197us (39822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603844.898177:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:3.0:1787603845.079192:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787603845.079348:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787603845.079370:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355181056:0@lo:13: 00000100:00100000:0.0:1787603845.079459:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603845.079539:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355181056 00000100:00100000:0.0:1787603845.079548:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355181056 00000100:00100000:0.0:1787603845.079624:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787603845.079634:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355181056:12345-0@lo:13: 00002000:00000024:0.0:1787603845.079656:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603845.079701:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355181056:12345-0@lo:13: Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603845.079708:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787603845.079729:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787603845.079761:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2c1b1ea00 x1874438355181056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603845.079780:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355181056:0@lo:13: 00000100:00100000:1.0:1787603845.080046:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787603845.080057:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355180928:0@lo:400: 00000100:00100000:1.0:1787603845.080093:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603845.082189:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355180928 00000100:00100000:0.0:1787603845.082203:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355180928 00000100:00100000:0.0:1787603845.082286:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787603845.082297:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355180928:12345-0@lo:400: 00000100:00100000:0.0:1787603845.082404:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355180928:12345-0@lo:400: Request processed in 108us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603845.082425:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787603845.082611:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d53800 x1874438355180928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603845.082627:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355180928:0@lo:400: 00000100:00100000:3.0:1787603845.082906:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355180800:0@lo:400: 00000100:00100000:3.0:1787603845.082961:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603845.083058:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355180800 00000100:00100000:1.0:1787603845.083063:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355180800 00000100:00100000:1.0:1787603845.083102:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787603845.083110:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355180800:12345-0@lo:400: 00000100:00100000:1.0:1787603845.083160:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355180800:12345-0@lo:400: Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603845.083167:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787603845.083346:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355180800:0@lo:400: 00000100:00100000:2.0:1787603845.083501:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787603845.083518:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355181184:0@lo:400: 00000100:00100000:2.0:1787603845.083550:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603845.083732:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355181440:0@lo:400: 00000100:00100000:0.0:1787603845.083763:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603845.083784:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787603845.083790:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355181312:0@lo:400: 00000100:00100000:0.0:1787603845.083813:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603845.083872:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355181440 00000100:00100000:0.0:1787603845.083877:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355181440 00000100:00100000:0.0:1787603845.083918:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787603845.083925:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355181440:12345-0@lo:400: 00000100:00100000:0.0:1787603845.083967:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355181440:12345-0@lo:400: Request processed in 42us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603845.083974:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787603845.083992:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787603845.084012:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d51f80 x1874438355181440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603845.084023:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787603845.084035:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355181440:0@lo:400: 00000100:00100000:1.0:1787603845.084154:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355181184 00000100:00100000:1.0:1787603845.084158:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355181184 00000100:00100000:1.0:1787603845.084200:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355181312 00000100:00100000:1.0:1787603845.084203:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355181312 00000100:00100000:1.0:1787603845.084224:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787603845.084231:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355181184:12345-0@lo:400: 00000100:00100000:1.0:1787603845.084279:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355181184:12345-0@lo:400: Request processed in 49us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603845.084299:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787603845.084312:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787603845.084319:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355181312:12345-0@lo:400: 00000100:00100000:1.0:1787603845.084353:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355181312:12345-0@lo:400: Request processed in 36us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603845.084359:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787603845.084399:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d53100 x1874438355181184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603845.084410:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355181184:0@lo:400: 00010000:00080000:1.0:1787603845.084439:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d53480 x1874438355181312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787603861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603845.084448:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355181312:0@lo:400: 00000100:00080000:0.0:1787603845.084768:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787603845.242742:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603845.242903:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345723008 00000100:00100000:1.0:1787603845.242915:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345723008 00000100:00100000:1.0:1787603845.242981:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:1.0:1787603845.242992:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:5635:x1874438345723008:12345-192.168.202.21@tcp:101: 00010000:00010000:1.0:1787603845.243011:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603845.243200:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2813a0e00/0xb5d1f3b1a1901407 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e592b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603845.243336:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2813a0000/0xb5d1f3b1a190140e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603845.243349:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2813a0000/0xb5d1f3b1a190140e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603845.243378:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2813a0000/0xb5d1f3b1a190140e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603845.243725:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787603845.243730:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787603845.243805:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2813a0000/0xb5d1f3b1a190140e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603845.243870:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2813a0e00/0xb5d1f3b1a1901407 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e592b expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603845.243889:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2813a0000/0xb5d1f3b1a190140e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e592b expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603845.243897:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:1.0:1787603845.243901:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787603845.243904:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2813a0000, rc 0) 00000100:00100000:1.0:1787603845.243971:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:5635:x1874438345723008:12345-192.168.202.21@tcp:101: Request processed in 981us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603845.243978:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 8 00010000:00010000:3.0:1787603845.528753:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603845.591166:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355181568:0@lo:13: 00000100:00100000:2.0:1787603845.591245:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603845.591397:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355181568 00000100:00100000:0.0:1787603845.591405:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355181568 00000100:00100000:0.0:1787603845.591471:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787603845.591481:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355181568:12345-0@lo:13: 00002000:00000024:0.0:1787603845.591508:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603845.591575:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355181568:12345-0@lo:13: Request processed in 94us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603845.591594:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787603845.591814:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b606dc00 x1874438355181568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603845.591867:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355181568:0@lo:13: 00010000:00010000:0.0:1787603846.551213:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603847.577557:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603847.735975:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603847.736068:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345723136 00000100:00100000:3.0:1787603847.736078:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345723136 00000100:00100000:3.0:1787603847.736217:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:3.0:1787603847.736230:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:5687:x1874438345723136:12345-192.168.202.21@tcp:41: 00000004:00000024:3.0:1787603847.736283:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787603847.736364:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:5687:x1874438345723136:12345-192.168.202.21@tcp:41: Request processed in 136us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603847.736371:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:3.0:1787603847.743206:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603847.743297:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345723264 00000100:00100000:2.0:1787603847.743307:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345723264 00000100:00080000:0.0:1787603847.744221:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787603847.744230:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603847.746933:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:2.0:1787603847.746954:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:5687:x1874438345723264:12345-192.168.202.21@tcp:13: 00002000:00000024:2.0:1787603847.746991:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787603847.747077:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:5687:x1874438345723264:12345-192.168.202.21@tcp:13: Request processed in 131us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603847.747084:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:1.0:1787603847.752444:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603847.752523:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345723392 00000100:00100000:3.0:1787603847.752534:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345723392 00000100:00100000:3.0:1787603847.752711:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:3.0:1787603847.752723:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:5687:x1874438345723392:12345-192.168.202.21@tcp:13: 00002000:00000024:3.0:1787603847.752761:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603847.753254:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:5687:x1874438345723392:12345-192.168.202.21@tcp:13: Request processed in 531us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603847.753263:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00080000:0.0:1787603847.758259:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787603848.600012:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787603848.747087:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000001:00100000:3.0:1787603849.247133:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a45d6158-dc8e-48e6-b534-483bf3fa20ad 00010000:00010000:0.0:1787603849.625508:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787603849.726629:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000100:00100000:1.0:1787603850.036755:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603850.036906:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345723648 00000100:00100000:3.0:1787603850.036918:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345723648 00000100:00100000:3.0:1787603850.037009:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 22 00000100:00100000:3.0:1787603850.037021:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2366:x1874438345723648:12345-192.168.202.21@tcp:400: 00000100:00080000:0.0:1787603850.037126:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603850.038756:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2366:x1874438345723648:12345-192.168.202.21@tcp:400: Request processed in 1728us (2003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603850.038770:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 22 00000100:00100000:1.0:1787603850.038948:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603850.039232:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603850.039327:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603850.039443:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345723904 00000100:00100000:0.0:1787603850.039452:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345723904 00000100:00100000:0.0:1787603850.039499:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345723776 00000100:00100000:0.0:1787603850.039502:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345723776 00000100:00100000:0.0:1787603850.039519:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:0.0:1787603850.039529:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345723904:12345-192.168.202.21@tcp:400: 00000100:00100000:0.0:1787603850.039598:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345723904:12345-192.168.202.21@tcp:400: Request processed in 70us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603850.039604:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:0.0:1787603850.039618:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:0.0:1787603850.039624:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345723776:12345-192.168.202.21@tcp:400: 00000100:00100000:0.0:1787603850.039648:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345723776:12345-192.168.202.21@tcp:400: Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603850.039654:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00080000:0.0:1787603850.039734:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787603850.039738:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787603850.040212:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345723520 00000100:00100000:2.0:1787603850.040217:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345723520 00000100:00100000:2.0:1787603850.040258:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 128 00000100:00100000:2.0:1787603850.040266:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2366:x1874438345723520:12345-192.168.202.21@tcp:400: 00000100:00100000:2.0:1787603850.040446:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2366:x1874438345723520:12345-192.168.202.21@tcp:400: Request processed in 181us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603850.040454:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 128 00000100:00100000:3.0:1787603850.199138:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355181696:0@lo:13: 00000100:00100000:3.0:1787603850.199208:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603850.199594:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355181696 00000100:00100000:0.0:1787603850.199603:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355181696 00000100:00100000:0.0:1787603850.199700:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787603850.199710:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355181696:12345-0@lo:13: 00002000:00000024:0.0:1787603850.199749:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603850.199821:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355181696:12345-0@lo:13: Request processed in 112us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603850.199828:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787603850.199888:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2c1b1c380 x1874438355181696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603850.199904:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355181696:0@lo:13: 00000100:00080000:3.0:1787603850.200135:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603850.202962:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355181824:0@lo:400: 00000100:00100000:3.0:1787603850.203045:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603850.203079:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355182336:0@lo:400: 00000100:00100000:3.0:1787603850.203100:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603850.203120:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787603850.203124:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355181952:0@lo:400: 00000100:00100000:3.0:1787603850.203143:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603850.203166:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355182080:0@lo:400: 00000100:00100000:3.0:1787603850.203184:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603850.203198:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787603850.203202:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355182208:0@lo:400: 00000100:00100000:3.0:1787603850.203217:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603850.203239:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355181824 00000100:00100000:3.0:1787603850.203245:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355181824 00000100:00100000:3.0:1787603850.203291:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787603850.203299:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355181824:12345-0@lo:400: 00000100:00100000:3.0:1787603850.203341:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355181824:12345-0@lo:400: Request processed in 43us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603850.203348:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787603850.203383:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355181952 00000100:00100000:3.0:1787603850.203386:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355181952 00000100:00100000:3.0:1787603850.203405:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355182080 00000100:00100000:3.0:1787603850.203407:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355182080 00000100:00100000:3.0:1787603850.203422:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355182208 00000100:00100000:3.0:1787603850.203424:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355182208 00000100:00100000:3.0:1787603850.203435:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787603850.203440:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355181952:12345-0@lo:400: 00000100:00100000:3.0:1787603850.203466:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355181952:12345-0@lo:400: Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603850.203472:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787603850.203481:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787603850.203486:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355182080:12345-0@lo:400: 00000100:00100000:3.0:1787603850.203507:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355182080:12345-0@lo:400: Request processed in 22us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603850.203512:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787603850.203521:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787603850.203526:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355182208:12345-0@lo:400: 00000100:00100000:3.0:1787603850.203543:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355182208:12345-0@lo:400: Request processed in 18us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603850.203548:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787603850.203562:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603850.203587:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355182208:0@lo:400: 00000100:00100000:3.0:1787603850.203597:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355182080:0@lo:400: 00000100:00100000:3.0:1787603850.203622:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355181952:0@lo:400: 00000100:00100000:3.0:1787603850.203629:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355181824:0@lo:400: 00000100:00100000:0.0:1787603850.204328:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355182336 00000100:00100000:0.0:1787603850.204334:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355182336 00000100:00100000:0.0:1787603850.204385:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787603850.204392:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355182336:12345-0@lo:400: 00000100:00100000:0.0:1787603850.204442:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355182336:12345-0@lo:400: Request processed in 50us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603850.204448:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787603850.204488:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2af7be300 x1874438355182336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603850.204499:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355182336:0@lo:400: 00000100:00080000:3.0:1787603850.205309:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787603850.647112:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603850.712119:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355182464:0@lo:13: 00000100:00100000:3.0:1787603850.712222:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603850.712370:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355182464 00000100:00100000:1.0:1787603850.712380:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355182464 00000100:00100000:1.0:1787603850.712450:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787603850.712464:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355182464:12345-0@lo:13: 00002000:00000024:1.0:1787603850.712509:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603850.712565:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355182464:12345-0@lo:13: Request processed in 104us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603850.712573:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787603850.712621:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470a80 x1874438355182464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603850.712655:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355182464:0@lo:13: 00000001:02000400:1.0:1787603851.205190:0:8283:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787603851.672110:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603852.703263:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603853.721770:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603854.743418:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603855.145493:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603855.145548:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603855.145575:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603855.145602:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603855.145634:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345724032 00000100:00100000:3.0:1787603855.145648:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345724032 00000100:00100000:3.0:1787603855.146145:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 130 00000100:00100000:3.0:1787603855.146162:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2363:x1874438345724032:12345-192.168.202.21@tcp:400: 00000100:00100000:3.0:1787603855.146263:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2363:x1874438345724032:12345-192.168.202.21@tcp:400: Request processed in 106us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603855.146319:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 130 00000100:00100000:0.0:1787603855.149347:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345724288 00000100:00100000:0.0:1787603855.149365:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345724288 00000100:00100000:0.0:1787603855.149455:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345724416 00000100:00100000:0.0:1787603855.149459:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345724416 00000100:00100000:0.0:1787603855.149485:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:0.0:1787603855.149498:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345724288:12345-192.168.202.21@tcp:400: 00000100:00100000:0.0:1787603855.149620:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345724288:12345-192.168.202.21@tcp:400: Request processed in 125us (4072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.149629:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:0.0:1787603855.149651:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:0.0:1787603855.149657:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345724416:12345-192.168.202.21@tcp:400: 00000100:00100000:0.0:1787603855.149679:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345724416:12345-192.168.202.21@tcp:400: Request processed in 23us (4078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.149685:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00080000:3.0:1787603855.150720:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787603855.150731:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603855.150779:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345724160 00000100:00100000:3.0:1787603855.150791:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345724160 00000100:00100000:3.0:1787603855.151084:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 26 00000100:00100000:3.0:1787603855.151100:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345724160:12345-192.168.202.21@tcp:400: 00000100:00100000:3.0:1787603855.151191:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345724160:12345-192.168.202.21@tcp:400: Request processed in 96us (5613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603855.151201:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 26 00000100:00080000:0.0:1787603855.151658:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603855.327796:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355182720:0@lo:400: 00000100:00100000:2.0:1787603855.327918:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603855.327987:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355183232:0@lo:400: 00000100:00100000:2.0:1787603855.328052:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603855.328092:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787603855.328099:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355182592:0@lo:400: 00000100:00100000:2.0:1787603855.328131:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603855.328153:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355183104:0@lo:400: 00000100:00100000:2.0:1787603855.328174:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603855.328203:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355182976:0@lo:400: 00000100:00100000:2.0:1787603855.328229:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603855.328251:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787603855.328256:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355182848:0@lo:400: 00000100:00100000:2.0:1787603855.328277:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603855.328310:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355182720 00000100:00100000:2.0:1787603855.328320:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355182720 00000100:00100000:2.0:1787603855.328378:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355183104 00000100:00100000:2.0:1787603855.328381:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355183104 00000100:00100000:2.0:1787603855.328407:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355182848 00000100:00100000:2.0:1787603855.328410:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355182848 00000100:00100000:2.0:1787603855.328428:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787603855.328438:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355182720:12345-0@lo:400: 00000100:00100000:2.0:1787603855.328628:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355182720:12345-0@lo:400: Request processed in 191us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603855.328636:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787603855.328656:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787603855.328662:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355183104:12345-0@lo:400: 00000100:00100000:2.0:1787603855.328687:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355183104:12345-0@lo:400: Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603855.328693:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787603855.328715:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787603855.328720:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355182848:12345-0@lo:400: 00000100:00100000:2.0:1787603855.328751:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355182848:12345-0@lo:400: Request processed in 31us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603855.328756:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787603855.328790:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355183232 00000100:00100000:2.0:1787603855.328794:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355183232 00000100:00100000:2.0:1787603855.328819:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355182976 00000100:00100000:2.0:1787603855.328823:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355182976 00000100:00100000:2.0:1787603855.328866:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787603855.328874:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355183232:12345-0@lo:400: 00000100:00100000:2.0:1787603855.328909:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355183232:12345-0@lo:400: Request processed in 37us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603855.328915:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787603855.328926:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787603855.328933:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355182976:12345-0@lo:400: 00000100:00100000:2.0:1787603855.328959:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355182976:12345-0@lo:400: Request processed in 27us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603855.328965:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787603855.328984:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355182592 00000100:00100000:2.0:1787603855.328988:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355182592 00000100:00100000:2.0:1787603855.329013:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787603855.329020:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355182592:12345-0@lo:400: 00000100:00100000:2.0:1787603855.329050:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355182592:12345-0@lo:400: Request processed in 31us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603855.329057:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1787603855.329099:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787603855.329111:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787603855.329113:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603855.329156:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355182848:0@lo:400: 00010000:00080000:2.0:1787603855.329172:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d51180 x1874438355182976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603855.329184:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355182976:0@lo:400: 00000100:00100000:2.0:1787603855.329218:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355182592:0@lo:400: 00000100:00100000:2.0:1787603855.329230:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355183104:0@lo:400: 00000100:00100000:2.0:1787603855.333149:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355182720:0@lo:400: 00010000:00080000:2.0:1787603855.333172:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d50a80 x1874438355183232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603855.333184:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355183232:0@lo:400: 00000100:00100000:2.0:1787603855.340982:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355183360:0@lo:13: 00000100:00100000:2.0:1787603855.341084:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603855.341192:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355183360 00000100:00100000:1.0:1787603855.341203:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355183360 00000100:00100000:1.0:1787603855.341276:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787603855.341288:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355183360:12345-0@lo:13: 00002000:00000024:1.0:1787603855.341339:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603855.341399:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355183360:12345-0@lo:13: Request processed in 113us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603855.341407:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787603855.341453:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470a80 x1874438355183360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603855.341511:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355183360:0@lo:13: 00000020:00000080:1.0:1787603855.381081:0:8430:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4a1bbca0 20000000:00000080:1.0:1787603855.381113:0:8430:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ed2bfc0d000 uarg=0000000000000000 20000000:01000000:1.0:1787603855.381167:0:8430:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787603855.381170:0:8430:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787603855.381173:0:8430:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787603855.381179:0:8430:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787603855.381186:0:8430:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787603855.381206:0:8430:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787603855.381210:0:8430:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787603855.381469:0:8430:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787603855.381472:0:8430:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787603855.384264:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787603855.385301:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787603855.385382:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787603855.385420:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1787603855.385436:0:8430:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787603855.385439:0:8430:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787603855.390283:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787603855.391018:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787603855.391078:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787603855.391115:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787603855.391132:0:8430:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787603855.391135:0:8430:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787603855.392229:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787603855.395946:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787603855.396042:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787603855.396080:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787603855.396092:0:8430:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787603855.396095:0:8430:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787603855.401706:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787603855.402827:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787603855.402922:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787603855.402977:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:1.0:1787603855.402998:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787603855.403032:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403053:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2813a1c00/0xb5d1f3b1a1901312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190130b expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403062:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a190133c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901335 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403070:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a1901366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190135f expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403077:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a1901374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190136d expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403084:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a1901382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190137b expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403091:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a190139e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901397 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403099:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2c217ca00/0xb5d1f3b1a19013c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19013c1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403109:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19013d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58c9 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403117:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed280030200/0xb5d1f3b1a19013dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58d0 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403124:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403187:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed280030200/0xb5d1f3b1a19013dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58d0 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403207:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed280030200/0xb5d1f3b1a19013dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58d0 expref: 9 pid: 5816 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.403226:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355183488:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603855.403362:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19013d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58c9 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403371:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19013d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58c9 expref: 9 pid: 5815 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.403379:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355183616:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603855.403410:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2c217ca00/0xb5d1f3b1a19013c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19013c1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403419:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2c217ca00/0xb5d1f3b1a19013c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19013c1 expref: 18 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.403428:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355183744:0@lo:104: 00000100:00100000:1.0:1787603855.403477:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787603855.403514:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a190139e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a1901397 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403523:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a190139e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901397 expref: 18 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.403544:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf472a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355183872:0@lo:104: 00000100:00100000:1.0:1787603855.403568:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787603855.403606:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a1901382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190137b expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403615:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a1901382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190137b expref: 18 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.403625:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf472680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355184000:0@lo:104: 00010000:00010000:1.0:1787603855.403646:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a1901374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190136d expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403654:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a1901374 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190136d expref: 18 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.403662:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355184128:0@lo:104: 00010000:00010000:1.0:1787603855.403682:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a1901366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190135f expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403690:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a1901366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190135f expref: 18 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.403699:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355184256:0@lo:104: 00010000:00010000:1.0:1787603855.403721:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a190133c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a1901335 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403729:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a190133c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901335 expref: 18 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.403748:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355184384:0@lo:104: 00010000:00010000:1.0:1787603855.403786:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2813a1c00/0xb5d1f3b1a1901312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190130b expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.403794:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2813a1c00/0xb5d1f3b1a1901312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190130b expref: 18 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.403802:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf473800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355184512:0@lo:104: 00000100:00100000:1.0:1787603855.403821:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b5c7f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787603855.404036:0:5805:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787603855.404059:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603855.404072:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603855.404081:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603855.404090:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603855.404098:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603855.404126:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355183744 00000100:00100000:0.0:1787603855.404134:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355183744 00000100:00100000:0.0:1787603855.404178:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355183872 00000100:00100000:0.0:1787603855.404181:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355183872 00000100:00100000:0.0:1787603855.404192:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355184000 00000100:00100000:0.0:1787603855.404194:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355184000 00000100:00100000:0.0:1787603855.404203:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355184128 00000100:00100000:0.0:1787603855.404205:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355184128 00000100:00100000:0.0:1787603855.404213:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355184256 00000100:00100000:0.0:1787603855.404215:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355184256 00000100:00100000:0.0:1787603855.404223:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355184384 00000100:00100000:0.0:1787603855.404225:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355184384 00000100:00100000:0.0:1787603855.404234:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355184512 00000100:00100000:0.0:1787603855.404236:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355184512 00000100:00100000:0.0:1787603855.404252:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787603855.404267:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+9:8430:x1874438355183744:12345-0@lo:104: 00010000:00010000:0.0:1787603855.404284:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19013c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.404356:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787603855.404364:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+9:8430:x1874438355183744:12345-0@lo:104: Request processed in 99us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.404371:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787603855.404391:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787603855.404397:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+8:8430:x1874438355183872:12345-0@lo:104: 00010000:00010000:0.0:1787603855.404403:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a190139e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.404437:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787603855.404442:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+8:8430:x1874438355183872:12345-0@lo:104: Request processed in 46us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.404447:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787603855.404515:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787603855.404522:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+7:8430:x1874438355184000:12345-0@lo:104: 00010000:00010000:0.0:1787603855.404530:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901382 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.404565:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787603855.404570:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+7:8430:x1874438355184000:12345-0@lo:104: Request processed in 50us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.404576:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787603855.404588:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787603855.404599:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+6:8430:x1874438355184128:12345-0@lo:104: 00010000:00010000:0.0:1787603855.404606:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901374 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.404634:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787603855.404639:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+6:8430:x1874438355184128:12345-0@lo:104: Request processed in 40us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.404644:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787603855.404656:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787603855.404661:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+5:8430:x1874438355184256:12345-0@lo:104: 00010000:00010000:0.0:1787603855.404668:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901366 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.404692:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787603855.404696:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+5:8430:x1874438355184256:12345-0@lo:104: Request processed in 36us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.404702:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787603855.404712:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787603855.404718:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+4:8430:x1874438355184384:12345-0@lo:104: 00010000:00010000:0.0:1787603855.404725:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a190133c expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.404749:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787603855.404754:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+4:8430:x1874438355184384:12345-0@lo:104: Request processed in 37us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.404759:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787603855.404782:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787603855.404794:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+3:8430:x1874438355184512:12345-0@lo:104: 00010000:00010000:0.0:1787603855.404802:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901312 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.404829:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1787603855.404834:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+3:8430:x1874438355184512:12345-0@lo:104: Request processed in 41us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.404876:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787603855.404898:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787603855.404905:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19013c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.404912:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed280030400 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603855.404917:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19013c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.404926:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19013c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787603855.404933:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19013c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603855.404940:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787603855.404977:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19013c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.404984:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787603855.405007:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19013c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405024:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed280030400/0xb5d1f3b1a19013c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19013c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405043:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787603855.405047:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a190139e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405052:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed280031400 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603855.405055:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a190139e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405063:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a190139e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787603855.405070:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a190139e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603855.405075:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787603855.405089:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190139e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405095:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787603855.405114:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190139e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405121:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed280031400/0xb5d1f3b1a1901397 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190139e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405130:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787603855.405138:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901382 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405144:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217c600 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603855.405147:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1901382 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405154:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1901382 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787603855.405160:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1901382 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603855.405165:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787603855.405179:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901382 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405185:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787603855.405189:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901382 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405196:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a190137b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901382 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405206:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787603855.405209:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901374 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405215:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dade00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603855.405218:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1901374 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405235:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1901374 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787603855.405242:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1901374 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603855.405248:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787603855.405261:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901374 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405267:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787603855.405273:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901374 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405280:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190136d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901374 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405290:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787603855.405293:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901366 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405299:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed280030800 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603855.405302:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1901366 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405309:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1901366 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787603855.405316:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1901366 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603855.405327:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787603855.405340:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901366 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405346:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787603855.405350:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901366 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405357:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed280030800/0xb5d1f3b1a190135f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901366 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405366:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787603855.405369:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a190133c expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405375:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2813a0a00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603855.405378:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a190133c expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405385:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a190133c expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787603855.405392:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a190133c expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603855.405398:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787603855.405409:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190133c expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405415:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787603855.405425:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190133c expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405431:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0a00/0xb5d1f3b1a1901335 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190133c expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405441:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787603855.405444:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901312 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405451:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2813a1800 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787603855.405453:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1901312 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405460:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1901312 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787603855.405466:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1901312 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603855.405471:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787603855.405484:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901312 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405490:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787603855.405493:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901312 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405499:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a190130b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901312 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.405514:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603855.405521:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603855.405524:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603855.405533:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603855.405541:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603855.405568:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355184640:0@lo:103: 00000100:00100000:0.0:1787603855.405619:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603855.405662:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355185152:0@lo:103: 00000100:00100000:0.0:1787603855.405700:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603855.405726:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787603855.405733:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355185024:0@lo:103: 00000100:00100000:0.0:1787603855.405754:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603855.405800:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355184768:0@lo:103: 00000100:00100000:0.0:1787603855.405825:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603855.405874:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355185280:0@lo:103: 00000100:00100000:0.0:1787603855.405896:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603855.405908:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787603855.405913:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355184896:0@lo:103: 00000100:00100000:0.0:1787603855.405935:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603855.405944:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355185408:0@lo:103: 00000100:00100000:0.0:1787603855.405967:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603855.406002:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355184640 00000100:00100000:0.0:1787603855.406010:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355184640 00010000:00010000:0.0:1787603855.406038:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2c217ca00/0xb5d1f3b1a19013c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19013c1 expref: 19 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603855.406059:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355185152 00000100:00100000:0.0:1787603855.406062:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355185152 00010000:00010000:0.0:1787603855.406074:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a1901366 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190135f expref: 20 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603855.406093:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355185024 00000100:00100000:0.0:1787603855.406096:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355185024 00010000:00010000:0.0:1787603855.406107:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a1901374 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190136d expref: 21 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603855.406116:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355184768 00000100:00100000:0.0:1787603855.406118:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355184768 00010000:00010000:0.0:1787603855.406127:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a190139e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901397 expref: 22 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603855.406136:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355185280 00000100:00100000:0.0:1787603855.406138:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355185280 00010000:00010000:0.0:1787603855.406147:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a190133c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901335 expref: 23 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603855.406156:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355184896 00000100:00100000:0.0:1787603855.406159:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355184896 00010000:00010000:0.0:1787603855.406169:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a1901382 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190137b expref: 24 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603855.406178:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355185408 00000100:00100000:0.0:1787603855.406181:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355185408 00010000:00010000:0.0:1787603855.406190:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2813a1c00/0xb5d1f3b1a1901312 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190130b expref: 25 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603855.406203:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787603855.406212:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290176a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+25:3282:x1874438355184640:12345-0@lo:103: 00010000:00010000:0.0:1787603855.406227:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603855.406232:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2c217ca00/0xb5d1f3b1a19013c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19013c1 expref: 25 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406251:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2c217ca00/0xb5d1f3b1a19013c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19013c1 expref: 25 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406274:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603855.406309:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290176a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+25:3282:x1874438355184640:12345-0@lo:103: Request processed in 97us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.406317:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787603855.406335:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787603855.406340:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+24:3282:x1874438355185152:12345-0@lo:103: 00010000:00010000:0.0:1787603855.406348:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603855.406353:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a1901366 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190135f expref: 24 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406362:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a1901366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190135f expref: 24 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406372:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603855.406392:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+24:3282:x1874438355185152:12345-0@lo:103: Request processed in 52us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.406399:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787603855.406411:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787603855.406418:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+23:3282:x1874438355185024:12345-0@lo:103: 00010000:00010000:0.0:1787603855.406425:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603855.406429:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a1901374 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190136d expref: 23 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406437:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a1901374 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190136d expref: 23 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406451:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603855.406472:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+23:3282:x1874438355185024:12345-0@lo:103: Request processed in 56us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.406479:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787603855.406492:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787603855.406497:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+22:3283:x1874438355184768:12345-0@lo:103: 00010000:00010000:0.0:1787603855.406505:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603855.406509:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a190139e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901397 expref: 22 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406517:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a190139e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901397 expref: 22 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406526:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603855.406552:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+22:3283:x1874438355184768:12345-0@lo:103: Request processed in 55us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.406558:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787603855.406570:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787603855.406576:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+21:3283:x1874438355185280:12345-0@lo:103: 00010000:00010000:0.0:1787603855.406583:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603855.406587:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a190133c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901335 expref: 21 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406595:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a190133c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901335 expref: 21 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406604:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603855.406630:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+21:3283:x1874438355185280:12345-0@lo:103: Request processed in 54us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.406636:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787603855.406648:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787603855.406653:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+20:3283:x1874438355184896:12345-0@lo:103: 00010000:00010000:0.0:1787603855.406664:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603855.406667:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a1901382 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190137b expref: 20 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406675:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a1901382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190137b expref: 20 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406684:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603855.406703:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+20:3283:x1874438355184896:12345-0@lo:103: Request processed in 50us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.406710:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787603855.406721:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787603855.406726:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa48c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355185408:12345-0@lo:103: 00010000:00010000:0.0:1787603855.406733:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603855.406737:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2813a1c00/0xb5d1f3b1a1901312 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190130b expref: 19 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406744:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2813a1c00/0xb5d1f3b1a1901312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190130b expref: 19 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.406752:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603855.406784:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa48c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355185408:12345-0@lo:103: Request processed in 58us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.406791:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787603855.406905:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355184896:0@lo:103: 00000100:00100000:0.0:1787603855.406917:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355185408:0@lo:103: 00000100:00100000:0.0:1787603855.406923:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355184768:0@lo:103: 00000100:00100000:0.0:1787603855.406929:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355185280:0@lo:103: 00000100:00100000:0.0:1787603855.406965:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355185024:0@lo:103: 00000100:00100000:0.0:1787603855.406973:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355184640:0@lo:103: 00000100:00100000:0.0:1787603855.406979:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355185152:0@lo:103: 00010000:00010000:1.0:1787603855.407557:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217ca00/0xb5d1f3b1a19013c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19013c1 expref: 18 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.407577:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355183744:0@lo:104: 00010000:00010000:1.0:1787603855.407593:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a190139e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a1901397 expref: 17 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.407602:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf472a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355183872:0@lo:104: 00010000:00010000:1.0:1787603855.407614:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a1901382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190137b expref: 16 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.407622:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf472680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355184000:0@lo:104: 00010000:00010000:1.0:1787603855.407634:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed280031a00/0xb5d1f3b1a1901374 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190136d expref: 15 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.407644:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355184128:0@lo:104: 00010000:00010000:1.0:1787603855.407654:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a1901366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190135f expref: 14 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.407680:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355184256:0@lo:104: 00010000:00010000:1.0:1787603855.407694:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a190133c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a1901335 expref: 13 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.407702:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355184384:0@lo:104: 00010000:00010000:1.0:1787603855.407711:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2813a1c00/0xb5d1f3b1a1901312 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190130b expref: 12 pid: 5813 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.407720:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf473800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355184512:0@lo:104: 00000100:00100000:2.0:1787603855.422526:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603855.422565:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603855.422669:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345724672 00000100:00100000:0.0:1787603855.422682:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345724672 00010000:00010000:0.0:1787603855.422736:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19013d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58c9 expref: 10 pid: 5815 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603855.422788:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345724544 00000100:00100000:0.0:1787603855.422792:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345724544 00010000:00010000:0.0:1787603855.422820:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed280030200/0xb5d1f3b1a19013dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58d0 expref: 11 pid: 5816 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603855.422866:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:0.0:1787603855.422879:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+11:2364:x1874438345724672:12345-192.168.202.21@tcp:103: 00010000:00010000:0.0:1787603855.422899:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603855.422906:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19013d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58c9 expref: 11 pid: 5815 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.422920:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19013d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58c9 expref: 11 pid: 5815 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.422968:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603855.423041:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+11:2364:x1874438345724672:12345-192.168.202.21@tcp:103: Request processed in 164us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.423049:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:0.0:1787603855.423073:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00100000:0.0:1787603855.423080:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2364:x1874438345724544:12345-192.168.202.21@tcp:103: 00010000:00010000:0.0:1787603855.423088:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603855.423092:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed280030200/0xb5d1f3b1a19013dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58d0 expref: 10 pid: 5816 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.423103:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed280030200/0xb5d1f3b1a19013dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58d0 expref: 10 pid: 5816 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.423117:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.423127:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.423145:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.423152:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.423160:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.423168:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.423185:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2813a0e00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787603855.423190:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.423198:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.423207:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603855.423218:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603855.423252:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2364:x1874438345724544:12345-192.168.202.21@tcp:103: Request processed in 172us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603855.423258:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 20 00010000:00010000:1.0:1787603855.427561:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed280030200/0xb5d1f3b1a19013dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58d0 expref: 9 pid: 5816 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.427596:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355183488:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603855.427623:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19013d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58c9 expref: 8 pid: 5815 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603855.427635:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874438355183616:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603855.427690:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.427702:0:8430:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.427709:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.427715:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2813a0e00/0xb5d1f3b1a1901415 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603855.767121:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603855.831124:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355185536:0@lo:13: 00000100:00100000:0.0:1787603855.831239:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603855.831451:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355185536 00000100:00100000:3.0:1787603855.831464:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355185536 00000100:00100000:3.0:1787603855.831537:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787603855.831549:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355185536:12345-0@lo:13: 00002000:00000024:3.0:1787603855.831685:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603855.831782:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355185536:12345-0@lo:13: Request processed in 224us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603855.831790:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787603855.832301:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470700 x1874438355185536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603855.832328:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355185536:0@lo:13: 00000100:00100000:1.0:1787603856.361014:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603856.361719:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345724800 00000100:00100000:3.0:1787603856.361736:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345724800 00000100:00100000:3.0:1787603856.361820:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 132 00000100:00100000:3.0:1787603856.361834:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+8:5608:x1874438345724800:12345-192.168.202.21@tcp:101: 00010000:00010000:3.0:1787603856.361896:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603856.361923:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dace00/0xb5d1f3b1a190141c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5932 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603856.361959:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dace00/0xb5d1f3b1a190141c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5932 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603856.361973:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b5dace00/0xb5d1f3b1a190141c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5932 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603856.361983:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dace00, rc 0) 00000100:00100000:3.0:1787603856.363298:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+9:5608:x1874438345724800:12345-192.168.202.21@tcp:101: Request processed in 1352us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603856.363312:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 132 00000100:00100000:0.0:1787603856.369266:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603856.369385:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345724928 00000100:00100000:2.0:1787603856.369402:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345724928 00000100:00100000:2.0:1787603856.369529:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 133 00000100:00100000:2.0:1787603856.369542:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+9:5608:x1874438345724928:12345-192.168.202.21@tcp:501: 00000100:00100000:2.0:1787603856.370008:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+9:5608:x1874438345724928:12345-192.168.202.21@tcp:501: Request processed in 464us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603856.370020:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 133 00000100:00100000:0.0:1787603856.376557:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603856.378148:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345725056 00000100:00100000:2.0:1787603856.378172:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345725056 00000100:00100000:2.0:1787603856.378268:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 134 00000100:00100000:2.0:1787603856.378281:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+9:5608:x1874438345725056:12345-192.168.202.21@tcp:503: 00000100:00100000:2.0:1787603856.378630:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+9:5608:x1874438345725056:12345-192.168.202.21@tcp:503: Request processed in 349us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603856.378638:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 134 00000100:00100000:1.0:1787603856.392457:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603856.394772:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345725184 00000100:00100000:2.0:1787603856.394796:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345725184 00000100:00100000:2.0:1787603856.394928:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 135 00000100:00100000:2.0:1787603856.394942:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+9:6076:x1874438345725184:12345-192.168.202.21@tcp:502: 00000100:00100000:2.0:1787603856.395355:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+9:6076:x1874438345725184:12345-192.168.202.21@tcp:502: Request processed in 413us (2910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603856.395365:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 135 00000100:00100000:1.0:1787603856.398463:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603856.407276:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345725312 00000100:00100000:3.0:1787603856.407298:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345725312 00000100:00100000:3.0:1787603856.407388:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 136 00000100:00100000:3.0:1787603856.407400:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+9:6076:x1874438345725312:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787603856.409225:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+9:6076:x1874438345725312:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 1813us (10762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603856.409256:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 136 00000100:00100000:1.0:1787603856.417150:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603856.417334:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345725440 00000100:00100000:0.0:1787603856.417349:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345725440 00000100:00100000:0.0:1787603856.417428:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 137 00000100:00100000:0.0:1787603856.417441:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+9:5608:x1874438345725440:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787603856.417465:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603856.417500:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a1901423 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5939 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603856.417537:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a1901423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5939 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603856.417569:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a1901423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5939 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603856.417580:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed281498800, rc 0) 00000100:00100000:0.0:1787603856.417668:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5608:x1874438345725440:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 Request processed in 229us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603856.417675:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 137 00000100:00100000:1.0:1787603856.431103:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603856.431529:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345725568 00000100:00100000:2.0:1787603856.431544:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345725568 00000100:00100000:2.0:1787603856.431622:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 138 00000100:00100000:2.0:1787603856.431634:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5608:x1874438345725568:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603856.432069:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5608:x1874438345725568:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 Request processed in 435us (980us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787603856.432079:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 138 00010000:00010000:1.0:1787603856.797453:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787603857.245236:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787603857.245246:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ed2b4d09000 from 39 10000000:01000000:0.0:1787603857.245254:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787603857.245319:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.245334:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.245349:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603857.245379:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355185664:0@lo:101: 00000100:00100000:0.0:1787603857.245804:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603857.245951:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9cfe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603857.250484:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355185664 00000100:00100000:2.0:1787603857.250505:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355185664 00000100:00100000:2.0:1787603857.250597:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787603857.250613:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+12:5818:x1874438355185664:12345-0@lo:101: 00010000:00010000:2.0:1787603857.250639:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603857.250679:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a1901431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190142a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.250716:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a1901431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190142a expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.250731:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a1901431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190142a expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.250742:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217cc00, rc 0) 00000100:00100000:2.0:1787603857.250885:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355185664:12345-0@lo:101: Request processed in 276us (5411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603857.250893:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787603857.255647:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355185664:0@lo:101: 00010000:00010000:0.0:1787603857.255689:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.255705:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603857.256020:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355185792:0@lo:501: 00000100:00100000:0.0:1787603857.256104:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603857.256362:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9cfe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787603857.259980:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355185792 00000100:00100000:3.0:1787603857.260010:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355185792 00000100:00100000:3.0:1787603857.260080:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787603857.260093:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355185792:12345-0@lo:501: 00000100:00100000:3.0:1787603857.260774:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355185792:12345-0@lo:501: Request processed in 678us (4664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603857.260786:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787603857.261198:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355185792:0@lo:501: 00000100:00100000:0.0:1787603857.261266:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355185920:0@lo:503: 00000100:00100000:0.0:1787603857.261336:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603857.262063:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9cfe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603857.267226:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355185920 00000100:00100000:2.0:1787603857.267245:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355185920 00000100:00100000:2.0:1787603857.267556:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787603857.267570:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355185920:12345-0@lo:503: 00000100:00100000:1.0:1787603857.268979:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355185920:0@lo:503: 00000100:00100000:2.0:1787603857.269137:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355185920:12345-0@lo:503: Request processed in 1569us (7800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603857.269148:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787603857.274538:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8459:1874438355186048:0@lo:502: 00000100:00100000:0.0:1787603857.274680:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603857.274757:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9cfe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603857.275195:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355186048 00000100:00100000:2.0:1787603857.275207:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355186048 00000100:00100000:2.0:1787603857.275270:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787603857.275283:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:8459:x1874438355186048:12345-0@lo:502: 00000100:00100000:2.0:1787603857.275632:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+13:8459:x1874438355186048:12345-0@lo:502: Request processed in 351us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603857.275641:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787603857.275903:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8459:1874438355186048:0@lo:502: 00000100:00100000:1.0:1787603857.275982:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8459:1874438355186176:0@lo:502: 00000100:00100000:1.0:1787603857.276041:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603857.276074:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2871c23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603857.277089:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355186176 00000100:00100000:2.0:1787603857.277102:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355186176 00000100:00100000:2.0:1787603857.277176:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787603857.277188:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:8459:x1874438355186176:12345-0@lo:502: 00000100:00100000:2.0:1787603857.278488:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+13:8459:x1874438355186176:12345-0@lo:502: Request processed in 1282us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603857.278503:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787603857.288046:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8459:1874438355186176:0@lo:502: 00000040:00080000:0.0:1787603857.288127:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787603857.289473:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787603857.289524:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787603857.289538:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.289553:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787603857.289565:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787603857.289568:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787603857.289571:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787603857.289628:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.289637:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.289650:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603857.289677:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355186304:0@lo:101: 00000100:00100000:2.0:1787603857.289774:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603857.289819:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286620f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787603857.291106:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355186304 00000100:00100000:0.0:1787603857.291123:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355186304 00000100:00100000:0.0:1787603857.291194:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787603857.291207:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+13:5818:x1874438355186304:12345-0@lo:101: 00010000:00010000:0.0:1787603857.291227:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603857.291248:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a190143f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901438 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.291284:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a190143f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901438 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.291296:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a190143f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901438 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.291328:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed281499000, rc 0) 00000100:00100000:0.0:1787603857.291410:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355186304:12345-0@lo:101: Request processed in 206us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603857.291417:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787603857.291700:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355186304:0@lo:101: 00010000:00010000:0.0:1787603857.291722:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.291734:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603857.291938:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355186432:0@lo:501: 00000100:00100000:0.0:1787603857.291984:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603857.292012:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9cfe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787603857.292031:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355186432 00000100:00100000:0.0:1787603857.292036:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355186432 00000100:00100000:0.0:1787603857.292068:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787603857.292075:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355186432:12345-0@lo:501: 00000100:00100000:0.0:1787603857.292397:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355186432:12345-0@lo:501: Request processed in 320us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603857.292405:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787603857.292444:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355186432:0@lo:501: 00000100:00100000:0.0:1787603857.294385:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355186560:0@lo:503: 00000100:00100000:0.0:1787603857.294557:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603857.294666:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9cfe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603857.295574:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355186560 00000100:00100000:2.0:1787603857.295938:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355186560 00000100:00100000:2.0:1787603857.296007:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787603857.296020:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355186560:12345-0@lo:503: 00000100:00100000:2.0:1787603857.296314:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355186560:12345-0@lo:503: Request processed in 296us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603857.296323:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787603857.299301:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355186560:0@lo:503: 00000100:00100000:2.0:1787603857.308140:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8460:1874438355186688:0@lo:502: 00000100:00100000:2.0:1787603857.308272:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603857.308332:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286620f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787603857.308453:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355186688 00000100:00100000:0.0:1787603857.308463:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355186688 00000100:00100000:0.0:1787603857.308534:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787603857.308546:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+14:8460:x1874438355186688:12345-0@lo:502: 00000100:00100000:0.0:1787603857.309113:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+14:8460:x1874438355186688:12345-0@lo:502: Request processed in 566us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603857.309124:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787603857.309195:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8460:1874438355186688:0@lo:502: 00000020:01000000:0.0:1787603857.309234:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787603857.309246:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787603857.309248:0:8460:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787603857.309254:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787603857.309289:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8460:1874438355186816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787603857.309336:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603857.309366:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355186816 00000100:00100000:0.0:1787603857.309371:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355186816 00000100:00100000:0.0:1787603857.309401:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787603857.309413:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:8460:x1874438355186816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787603857.309698:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:8460:x1874438355186816:12345-0@lo:502:llog_process_th.0 Request processed in 287us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603857.309706:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787603857.309740:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9cfe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787603857.309765:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8460:1874438355186816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787603857.309787:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787603857.309792:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787603857.309794:0:8460:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787603857.309797:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787603857.312742:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787603857.312803:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787603857.312819:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.313007:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603857.313024:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787603857.313027:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ed286a76000 from 39 10000000:01000000:1.0:1787603857.313040:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787603857.313091:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.313100:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.313114:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603857.313145:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355186944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.313230:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603857.313271:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2871c2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787603857.313407:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355186944 00000100:00100000:0.0:1787603857.313418:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355186944 00000100:00100000:0.0:1787603857.313487:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787603857.313499:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:5818:x1874438355186944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787603857.313515:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603857.313531:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed281498c00/0xb5d1f3b1a190144d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901446 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.313561:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed281498c00/0xb5d1f3b1a190144d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901446 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.313573:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed281498c00/0xb5d1f3b1a190144d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901446 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.313582:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed281498c00, rc 0) 00000100:00100000:0.0:1787603857.313641:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355186944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603857.313648:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787603857.313798:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355186944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787603857.313815:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.313825:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603857.314104:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355187072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.314143:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603857.314166:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2871c2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787603857.314312:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355187072 00000100:00100000:0.0:1787603857.314317:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355187072 00000100:00100000:0.0:1787603857.314373:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787603857.314383:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355187072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787603857.314967:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355187072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 584us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603857.314977:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787603857.321930:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355187072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787603857.322020:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355187200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787603857.322126:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603857.322179:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed181249c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.322358:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355187200 00000100:00100000:1.0:1787603857.322367:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355187200 00000100:00100000:1.0:1787603857.322442:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787603857.322455:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355187200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.322734:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355187200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 281us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.322768:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787603857.322828:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355187200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787603857.324956:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8462:1874438355187328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603857.325055:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603857.325104:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295142180 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.326636:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355187328 00000100:00100000:1.0:1787603857.326652:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355187328 00000100:00100000:1.0:1787603857.326714:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787603857.326727:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+15:8462:x1874438355187328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787603857.327130:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+15:8462:x1874438355187328:12345-0@lo:502:llog_process_th.0 Request processed in 405us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.327139:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787603857.327633:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8462:1874438355187328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603857.327712:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8462:1874438355187456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603857.327783:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603857.327831:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295142180 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.329436:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355187456 00000100:00100000:1.0:1787603857.329452:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355187456 00000100:00100000:1.0:1787603857.329531:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787603857.329543:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:8462:x1874438355187456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787603857.330098:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:8462:x1874438355187456:12345-0@lo:502:llog_process_th.0 Request processed in 555us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.330108:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787603857.330263:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8462:1874438355187456:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787603857.330309:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787603857.331134:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787603857.331164:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787603857.331179:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.331193:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603857.331204:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787603857.331208:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787603857.331223:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787603857.331268:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.331278:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.331290:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603857.331321:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf473800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355187584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.331384:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603857.331428:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed1812499c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787603857.332016:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355187584 00000100:00100000:3.0:1787603857.332027:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355187584 00000100:00100000:3.0:1787603857.332088:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787603857.332098:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+15:5818:x1874438355187584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787603857.332115:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603857.332132:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dac600/0xb5d1f3b1a190145b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901454 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.332160:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dac600/0xb5d1f3b1a190145b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901454 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.332173:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b5dac600/0xb5d1f3b1a190145b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901454 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.332184:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac600, rc 0) 00000100:00100000:3.0:1787603857.332238:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355187584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603857.332245:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787603857.333091:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf473800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355187584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787603857.333120:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.333134:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603857.333222:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf473800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355187712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.333273:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603857.333317:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed1812499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.333334:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355187712 00000100:00100000:1.0:1787603857.333339:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355187712 00000100:00100000:1.0:1787603857.333374:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787603857.333382:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355187712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.338046:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355187712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4647us (4756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.338073:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787603857.338336:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf473800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355187712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787603857.338413:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355187840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787603857.338669:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603857.338709:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2951423c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.338795:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355187840 00000100:00100000:1.0:1787603857.338803:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355187840 00000100:00100000:0.0:1787603857.339238:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787603857.339254:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355187840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787603857.339519:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355187840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603857.339534:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787603857.339977:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355187840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787603857.341196:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8463:1874438355187968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787603857.341285:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603857.341340:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b4971840 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.341706:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355187968 00000100:00100000:1.0:1787603857.341715:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355187968 00000100:00100000:1.0:1787603857.341778:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787603857.341790:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:8463:x1874438355187968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787603857.343313:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:8463:x1874438355187968:12345-0@lo:502:llog_process_th.0 Request processed in 1515us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.343328:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787603857.343976:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8463:1874438355187968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787603857.344024:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787603857.344036:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787603857.344039:0:8463:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787603857.344045:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787603857.344095:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8463:1874438355188096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787603857.344159:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603857.344199:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b4971840 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.344582:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355188096 00000100:00100000:1.0:1787603857.344659:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355188096 00000100:00100000:1.0:1787603857.344721:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787603857.344732:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+16:8463:x1874438355188096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787603857.345741:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+16:8463:x1874438355188096:12345-0@lo:502:llog_process_th.0 Request processed in 1003us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.345763:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787603857.346264:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8463:1874438355188096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787603857.346302:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787603857.346311:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787603857.346313:0:8463:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787603857.346317:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787603857.346532:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787603857.346574:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787603857.346598:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.346620:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603857.346632:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787603857.346635:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ed29010d000 from 39 10000000:01000000:1.0:1787603857.346649:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787603857.346689:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.346697:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.346707:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603857.346728:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355188224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.346789:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603857.346832:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2600 going to sleep for 11 seconds 00000100:00100000:0.0:1787603857.347252:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355188224 00000100:00100000:0.0:1787603857.347261:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355188224 00000100:00100000:0.0:1787603857.347318:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787603857.347330:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355188224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787603857.347344:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603857.347376:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298595000/0xb5d1f3b1a1901469 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901462 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.347407:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298595000/0xb5d1f3b1a1901469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901462 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.347429:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298595000/0xb5d1f3b1a1901469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901462 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.347440:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595000, rc 0) 00000100:00100000:0.0:1787603857.347498:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355188224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603857.347505:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787603857.347637:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355188224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787603857.347653:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.347662:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603857.347723:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355188352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603857.347769:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603857.347793:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286b19240 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.348132:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355188352 00000100:00100000:1.0:1787603857.348138:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355188352 00000100:00100000:1.0:1787603857.348176:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787603857.348185:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355188352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.348496:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355188352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.348504:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787603857.354231:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355188352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603857.354319:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355188480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787603857.354419:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603857.354466:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286b19240 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.354617:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355188480 00000100:00100000:1.0:1787603857.354625:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355188480 00000100:00100000:1.0:1787603857.354692:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787603857.354702:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355188480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.354996:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355188480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 293us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.355004:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787603857.355254:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355188480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787603857.356373:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8466:1874438355188608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603857.356453:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603857.356569:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355188608 00000100:00100000:1.0:1787603857.356593:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355188608 00000100:00100000:1.0:1787603857.356647:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787603857.356656:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:8466:x1874438355188608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787603857.359044:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:8466:x1874438355188608:12345-0@lo:502:llog_process_th.0 Request processed in 2373us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.359064:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787603857.359423:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286b19c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787603857.359457:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8466:1874438355188608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603857.360093:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8466:1874438355188736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603857.360167:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603857.360578:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286b19c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787603857.361874:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355188736 00000100:00100000:3.0:1787603857.361888:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355188736 00000100:00100000:3.0:1787603857.361959:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787603857.361972:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:8466:x1874438355188736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603857.362360:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:8466:x1874438355188736:12345-0@lo:502:llog_process_th.0 Request processed in 389us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603857.362377:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787603857.362729:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8466:1874438355188736:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787603857.362782:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787603857.363106:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787603857.363128:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787603857.363141:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.363153:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603857.363165:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787603857.363168:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787603857.363171:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787603857.363215:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.363223:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.363234:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603857.363259:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355188864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787603857.363317:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603857.363365:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2951423c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.363419:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355188864 00000100:00100000:1.0:1787603857.363427:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355188864 00000100:00100000:1.0:1787603857.363487:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787603857.363498:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355188864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787603857.363511:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603857.363527:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2813a0a00/0xb5d1f3b1a1901477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901470 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.363552:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2813a0a00/0xb5d1f3b1a1901477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901470 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.363564:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2813a0a00/0xb5d1f3b1a1901477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901470 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.363574:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2813a0a00, rc 0) 00000100:00100000:1.0:1787603857.363753:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355188864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.363761:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787603857.363931:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355188864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787603857.363948:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.363959:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603857.364017:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355188992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787603857.364048:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603857.364068:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b4971000 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.364125:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355188992 00000100:00100000:1.0:1787603857.364130:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355188992 00000100:00100000:1.0:1787603857.364158:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787603857.364166:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355188992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.364561:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355188992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 395us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.364570:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787603857.364679:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355188992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.364715:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355189120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.364768:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603857.364783:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2540 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.364797:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355189120 00000100:00100000:1.0:1787603857.364801:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355189120 00000100:00100000:1.0:1787603857.364821:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787603857.364828:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355189120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.365158:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355189120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 329us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.365165:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787603857.365300:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355189120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787603857.373261:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8467:1874438355189248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603857.373377:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603857.373440:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286b19c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787603857.373521:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355189248 00000100:00100000:3.0:1787603857.373531:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355189248 00000100:00100000:3.0:1787603857.373602:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787603857.373620:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:8467:x1874438355189248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603857.373977:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:8467:x1874438355189248:12345-0@lo:502:llog_process_th.0 Request processed in 357us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603857.373987:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787603857.374278:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8467:1874438355189248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787603857.374316:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787603857.374329:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787603857.374332:0:8467:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787603857.374339:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787603857.374367:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8467:1874438355189376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603857.374411:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603857.374450:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286b19c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787603857.374649:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355189376 00000100:00100000:0.0:1787603857.374657:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355189376 00000100:00100000:0.0:1787603857.374699:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787603857.374711:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:8467:x1874438355189376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787603857.375557:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:8467:x1874438355189376:12345-0@lo:502:llog_process_th.0 Request processed in 842us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603857.375582:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787603857.375882:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8467:1874438355189376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787603857.375916:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603857.375923:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603857.375925:0:8467:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787603857.375929:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787603857.376066:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787603857.376087:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787603857.376099:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.376112:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603857.376123:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787603857.376127:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ed28654cd28 from 1 10000000:01000000:0.0:1787603857.376130:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787603857.376165:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a190147e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.376173:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a190147e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.376183:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a190147e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603857.376203:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355189504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787603857.376248:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603857.376287:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286620f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.376403:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355189504 00000100:00100000:1.0:1787603857.376410:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355189504 00000100:00100000:1.0:1787603857.376459:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787603857.376470:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355189504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787603857.376493:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603857.376528:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2bec7e000/0xb5d1f3b1a1901485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190147e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.376559:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2bec7e000/0xb5d1f3b1a1901485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190147e expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.376571:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2bec7e000/0xb5d1f3b1a1901485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190147e expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.376601:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e000, rc 0) 00000100:00100000:1.0:1787603857.376645:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355189504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.376652:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787603857.376688:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355189504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787603857.376703:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a190147e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.376713:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a190147e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603857.376776:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355189632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.376803:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603857.376818:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603857.376831:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355189632 00000100:00100000:1.0:1787603857.376865:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355189632 00000100:00100000:1.0:1787603857.376889:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787603857.376896:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355189632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603857.377159:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355189632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (354us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787603857.377166:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787603857.377197:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355189632:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787603857.377219:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787603857.377224:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a190147e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.377238:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a190147e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787603857.688275:0:8489:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7ff64430 20000000:00000080:1.0:1787603857.688302:0:8489:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ed283ee4000 uarg=0000000000000000 20000000:01000000:1.0:1787603857.688350:0:8489:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787603857.688358:0:8489:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787603857.688365:0:8489:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787603857.693319:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787603857.693619:0:8489:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787603857.700462:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787603857.700668:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787603857.700724:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787603857.700755:0:8489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787603857.700782:0:8489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.700828:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2813a0200/0xb5d1f3b1a1901201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19011fa expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.701200:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a1901263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190125c expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.701210:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a190132e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901327 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.701222:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2813a1200/0xb5d1f3b1a19013eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5901 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.701230:0:8489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.701285:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2813a1200/0xb5d1f3b1a19013eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5901 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.701305:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2813a1200/0xb5d1f3b1a19013eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5901 expref: 9 pid: 5813 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603857.701324:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874438355189760:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603857.701456:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a190132e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a1901327 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.701465:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a190132e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901327 expref: 18 pid: 5816 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603857.702229:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874438355189888:0@lo:104: 00000100:00100000:0.0:1787603857.702303:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787603857.702376:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a1901263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190125c expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.702386:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a1901263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190125c expref: 18 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603857.702395:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874438355190016:0@lo:104: 00000100:00100000:0.0:1787603857.702424:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787603857.702447:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2813a0200/0xb5d1f3b1a1901201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19011fa expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.702455:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2813a0200/0xb5d1f3b1a1901201 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011fa expref: 18 pid: 5816 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603857.702464:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874438355190144:0@lo:104: 00000100:00100000:0.0:1787603857.704808:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286620f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787603857.705128:0:5805:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787603857.705169:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603857.705199:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355189888 00000100:00100000:3.0:1787603857.705209:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355189888 00000100:00100000:3.0:1787603857.705376:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355190016 00000100:00100000:3.0:1787603857.705380:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355190016 00000100:00100000:3.0:1787603857.705394:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355190144 00000100:00100000:3.0:1787603857.705397:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355190144 00000100:00100000:3.0:1787603857.705411:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787603857.705423:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+5:8489:x1874438355189888:12345-0@lo:104: 00010000:00010000:3.0:1787603857.705445:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a190132e expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.705533:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787603857.705540:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+5:8489:x1874438355189888:12345-0@lo:104: Request processed in 119us (3238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603857.705547:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787603857.705569:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787603857.705576:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2becabc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+4:8489:x1874438355190016:12345-0@lo:104: 00010000:00010000:3.0:1787603857.705613:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901263 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.705650:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787603857.705655:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2becabc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+4:8489:x1874438355190016:12345-0@lo:104: Request processed in 81us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603857.705661:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787603857.705713:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787603857.705720:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+3:8489:x1874438355190144:12345-0@lo:104: 00010000:00010000:3.0:1787603857.705728:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed281498400/0xb5d1f3b1a19011fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901201 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.705773:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787603857.705778:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+3:8489:x1874438355190144:12345-0@lo:104: Request processed in 59us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603857.705785:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787603857.705816:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787603857.705824:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a190132e expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.705832:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2813a0600 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603857.705863:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a190132e expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.705875:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a190132e expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603857.705883:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a190132e expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603857.705897:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787603857.706395:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190132e expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.706404:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603857.706440:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190132e expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.706448:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0600/0xb5d1f3b1a1901327 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190132e expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.706465:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787603857.706572:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901263 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.706644:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed280030c00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603857.706649:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1901263 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.706657:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1901263 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603857.706664:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1901263 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603857.706669:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787603857.706695:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901263 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.706700:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603857.706723:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901263 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.706728:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed280030c00/0xb5d1f3b1a190125c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901263 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.706738:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603857.706749:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed281498400/0xb5d1f3b1a19011fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901201 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.706755:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed281498400 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603857.706758:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed281498400/0xb5d1f3b1a19011fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1901201 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.706766:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed281498400/0xb5d1f3b1a19011fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1901201 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603857.706775:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed281498400/0xb5d1f3b1a19011fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1901201 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603857.706781:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787603857.706895:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355190272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787603857.706955:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603857.706980:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355190272 00000100:00100000:2.0:1787603857.706988:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355190272 00010000:00010000:2.0:1787603857.707021:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a190132e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901327 expref: 19 pid: 5816 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603857.707053:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787603857.707062:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf471180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355190272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787603857.707224:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787603857.707274:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874438355189760:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603857.707288:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874438355189888:0@lo:104: 00000100:00100000:0.0:1787603857.707298:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874438355190016:0@lo:104: 00000100:00100000:0.0:1787603857.707306:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874438355190144:0@lo:104: 00010000:00010000:0.0:1787603857.707337:0:8489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.707496:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a190132e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901327 expref: 19 pid: 5816 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.707509:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a190132e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901327 expref: 19 pid: 5816 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.707527:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a190132e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a1901327 expref: 19 pid: 5816 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.707545:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603857.707594:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf471180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:3282:x1874438355190272:12345-0@lo:103:ldlm_bl.0 Request processed in 534us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603857.707602:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787603857.707603:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed281498400/0xb5d1f3b1a19011fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901201 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.707609:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603857.707618:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed281498400/0xb5d1f3b1a19011fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901201 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.707625:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed281498400/0xb5d1f3b1a19011fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901201 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.707641:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603857.707650:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603857.707652:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603857.707659:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603857.707666:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603857.707681:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355190400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787603857.707713:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603857.707753:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787603857.707759:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355190528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787603857.707784:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603857.707828:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355190400 00000100:00100000:3.0:1787603857.707834:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355190400 00010000:00010000:3.0:1787603857.707874:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a1901263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190125c expref: 18 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603857.707894:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355190528 00000100:00100000:3.0:1787603857.707897:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355190528 00010000:00010000:3.0:1787603857.707909:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2813a0200/0xb5d1f3b1a1901201 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011fa expref: 19 pid: 5816 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603857.707926:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787603857.707933:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355190400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787603857.707943:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603857.707947:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a1901263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190125c expref: 19 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.707956:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a1901263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190125c expref: 19 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603857.707967:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed281499600/0xb5d1f3b1a1901263 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190125c expref: 19 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603857.707986:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787603857.707987:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603857.707994:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:3283:x1874438355190528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787603857.708002:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603857.708007:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2813a0200/0xb5d1f3b1a1901201 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011fa expref: 18 pid: 5816 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.708016:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2813a0200/0xb5d1f3b1a1901201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19011fa expref: 18 pid: 5816 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.708027:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2813a0200/0xb5d1f3b1a1901201 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19011fa expref: 18 pid: 5816 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.708036:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603857.708239:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355190272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787603857.708462:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:3283:x1874438355190528:12345-0@lo:103:ldlm_bl.0 Request processed in 467us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603857.708485:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787603857.708682:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a643876-f930-492c-81cb-9dcff9ce6b60+16:3283:x1874438355190400:12345-0@lo:103:ldlm_bl.0 Request processed in 749us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603857.708688:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787603857.708969:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355190528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787603857.708973:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603857.708979:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355190400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787603857.708999:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345725696 00000100:00100000:1.0:1787603857.709004:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345725696 00010000:00010000:1.0:1787603857.709343:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2813a1200/0xb5d1f3b1a19013eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5901 expref: 10 pid: 5813 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603857.709377:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 24 00000100:00100000:1.0:1787603857.709387:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2363:x1874438345725696:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603857.709400:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603857.709405:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2813a1200/0xb5d1f3b1a19013eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5901 expref: 10 pid: 5813 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.709414:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2813a1200/0xb5d1f3b1a19013eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5901 expref: 10 pid: 5813 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.709437:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2813a1200/0xb5d1f3b1a19013eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5901 expref: 10 pid: 5813 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.709451:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.709457:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.709480:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.709485:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.709490:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.709495:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.709498:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595600 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787603857.709502:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.709507:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.709521:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603857.709541:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787603857.709543:0:8489:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.709551:0:8489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603857.709557:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed298595600/0xb5d1f3b1a190148c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603857.709689:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f844a97d-1878-4049-bbc8-d860aeb2443e+9:2363:x1874438345725696:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 303us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603857.709697:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 24 00010000:00010000:3.0:1787603857.815036:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603857.833126:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603857.833334:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345725824 00000100:00100000:0.0:1787603857.833349:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345725824 00000100:00100000:0.0:1787603857.833423:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 171 00000100:00100000:0.0:1787603857.833437:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+9:5608:x1874438345725824:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787603857.833477:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603857.833506:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a1901493 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5940 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.833544:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a1901493 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5940 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.833557:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a1901493 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5940 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603857.833569:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595200, rc 0) 00000100:00100000:0.0:1787603857.833638:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5608:x1874438345725824:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 Request processed in 204us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603857.833645:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 171 00000100:00100000:3.0:1787603857.836471:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603857.839566:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345725952 00000100:00100000:0.0:1787603857.839590:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345725952 00000100:00100000:0.0:1787603857.839672:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 172 00000100:00100000:0.0:1787603857.839685:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5608:x1874438345725952:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787603857.840179:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5608:x1874438345725952:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 Request processed in 494us (3718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603857.840189:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 172 00000100:00100000:1.0:1787603857.854244:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603857.857436:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345726080 00000100:00100000:2.0:1787603857.857457:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345726080 00000100:00100000:2.0:1787603857.857540:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 173 00000100:00100000:2.0:1787603857.857553:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5608:x1874438345726080:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787603857.860866:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:5608:x1874438345726080:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 Request processed in 3298us (6621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603857.860885:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 173 00000100:00100000:2.0:1787603857.872498:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603857.875584:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345726208 00000100:00100000:0.0:1787603857.875604:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345726208 00000100:00100000:0.0:1787603857.875733:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 174 00000100:00100000:0.0:1787603857.875759:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:6104:x1874438345726208:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787603857.877566:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:6104:x1874438345726208:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 1798us (5068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603857.877593:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 174 00000100:00100000:0.0:1787603857.898494:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603857.901867:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345726336 00000100:00100000:2.0:1787603857.901884:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345726336 00000100:00100000:2.0:1787603857.901955:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 175 00000100:00100000:2.0:1787603857.901965:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:6104:x1874438345726336:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787603857.902225:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:6104:x1874438345726336:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 260us (3759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603857.902240:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 175 00010000:00010000:3.0:1787603858.839143:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787603859.224666:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787603859.224675:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed2b4d09000 from 4 10000000:01000000:2.0:1787603859.224681:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787603859.224742:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.224754:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.224774:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603859.224799:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355190656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.224901:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603859.224952:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.224979:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355190656 00000100:00100000:2.0:1787603859.224987:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355190656 00000100:00100000:2.0:1787603859.225034:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787603859.225043:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355190656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787603859.225055:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603859.225068:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a19014a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190149a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.225090:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a19014a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190149a expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.225100:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a19014a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190149a expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.225123:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217da00, rc 0) 00000100:00100000:2.0:1787603859.225159:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355190656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.225165:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787603859.225207:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355190656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787603859.225220:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19014a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.225229:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19014a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603859.225278:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355190784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.225300:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603859.225315:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.225327:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355190784 00000100:00100000:2.0:1787603859.225330:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355190784 00000100:00100000:2.0:1787603859.225350:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787603859.225356:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355190784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.225603:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355190784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.225610:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787603859.225639:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355190784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.225663:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355190912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.225699:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603859.225720:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.225742:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355190912 00000100:00100000:2.0:1787603859.225745:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355190912 00000100:00100000:2.0:1787603859.225766:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787603859.225773:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355190912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.225924:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355190912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.225931:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787603859.225965:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355190912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787603859.244285:0:8549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8549:1874438355191040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603859.244373:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603859.244422:0:8549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.244587:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355191040 00000100:00100000:2.0:1787603859.244593:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355191040 00000100:00100000:2.0:1787603859.244640:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787603859.244646:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:8549:x1874438355191040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603859.245668:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:8549:x1874438355191040:12345-0@lo:502:llog_process_th.0 Request processed in 1019us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.245676:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787603859.245927:0:8549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8549:1874438355191040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787603859.245967:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787603859.245976:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603859.245977:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787603859.245982:0:8549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ed2b4d09000 00000020:00000080:3.0:1787603859.245983:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787603859.246051:0:8549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8549:1874438355191168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603859.246085:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603859.246105:0:8549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706a300 going to sleep for 11 seconds 00000100:00100000:3.0:1787603859.247263:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355191168 00000100:00100000:3.0:1787603859.247274:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355191168 00000100:00100000:3.0:1787603859.247334:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787603859.247343:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:8549:x1874438355191168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603859.247574:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:8549:x1874438355191168:12345-0@lo:502:llog_process_th.0 Request processed in 231us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603859.247582:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787603859.247640:0:8549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8549:1874438355191168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787603859.247671:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603859.247677:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603859.247679:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787603859.247683:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787603859.249322:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787603859.249349:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787603859.249360:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19014a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.249372:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19014a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787603859.249382:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787603859.249385:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed286a76000 from 4 10000000:01000000:2.0:1787603859.249387:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787603859.249421:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.249435:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.249445:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603859.249467:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355191296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.249520:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603859.249553:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.249573:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355191296 00000100:00100000:2.0:1787603859.249578:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355191296 00000100:00100000:2.0:1787603859.249613:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787603859.249622:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355191296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787603859.249633:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603859.249644:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19014af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19014a8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.249664:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19014af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19014a8 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.249674:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19014af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19014a8 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.249682:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217dc00, rc 0) 00000100:00100000:2.0:1787603859.249712:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355191296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.249718:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787603859.249776:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355191296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787603859.249788:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19014af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.249796:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19014af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603859.249868:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355191424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.249892:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603859.249910:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.249929:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355191424 00000100:00100000:2.0:1787603859.249932:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355191424 00000100:00100000:2.0:1787603859.249951:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787603859.249957:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355191424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.250164:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355191424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.250171:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787603859.250199:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355191424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.250225:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355191552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.250258:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603859.250270:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.250281:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355191552 00000100:00100000:2.0:1787603859.250284:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355191552 00000100:00100000:2.0:1787603859.250306:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787603859.250311:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355191552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.250448:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355191552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.250460:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787603859.250467:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355191552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787603859.259121:0:8552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8552:1874438355191680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603859.259412:0:8552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603859.259450:0:8552:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.260623:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355191680 00000100:00100000:2.0:1787603859.260633:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355191680 00000100:00100000:2.0:1787603859.260674:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787603859.260682:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:8552:x1874438355191680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603859.265081:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:8552:x1874438355191680:12345-0@lo:502:llog_process_th.0 Request processed in 4387us (5658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.265096:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787603859.267257:0:8552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8552:1874438355191680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787603859.267324:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787603859.267334:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603859.267336:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787603859.267343:0:8552:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ed286a76000 00000020:00000080:3.0:1787603859.267346:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787603859.267429:0:8552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8552:1874438355191808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603859.267507:0:8552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603859.267545:0:8552:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.273579:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355191808 00000100:00100000:2.0:1787603859.273596:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355191808 00000100:00100000:2.0:1787603859.273713:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787603859.273724:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:8552:x1874438355191808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603859.275271:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:8552:x1874438355191808:12345-0@lo:502:llog_process_th.0 Request processed in 1544us (7758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.275283:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787603859.277265:0:8552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8552:1874438355191808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787603859.277317:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787603859.277326:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787603859.277328:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787603859.277333:0:8552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787603859.277435:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787603859.277456:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787603859.277467:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19014af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603859.277479:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19014af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603859.277490:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787603859.277493:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed29010d000 from 4 10000000:01000000:1.0:1787603859.277496:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787603859.277529:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603859.277537:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603859.277546:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603859.277567:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf472a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355191936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787603859.277620:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603859.277655:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2180 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.277666:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355191936 00000100:00100000:2.0:1787603859.277672:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355191936 00000100:00100000:2.0:1787603859.277711:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787603859.277719:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355191936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787603859.277747:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603859.277759:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a19014bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19014b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.277789:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a19014bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19014b6 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.277800:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a19014bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19014b6 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.277809:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217de00, rc 0) 00000100:00100000:2.0:1787603859.277866:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355191936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.277873:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787603859.277908:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf472a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355191936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787603859.277919:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19014bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603859.277927:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19014bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603859.278696:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355192064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.278801:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603859.278868:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf51dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.278895:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355192064 00000100:00100000:2.0:1787603859.278900:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355192064 00000100:00100000:2.0:1787603859.278929:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787603859.278936:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355192064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.279496:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355192064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 558us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.279513:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787603859.279553:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355192064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.279584:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355192192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.279621:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603859.279719:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf51dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.279812:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355192192 00000100:00100000:2.0:1787603859.279817:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355192192 00000100:00100000:2.0:1787603859.279856:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787603859.279865:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355192192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787603859.280095:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355192192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.280102:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787603859.280286:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355192192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787603859.285553:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8555:1874438355192320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603859.286822:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603859.286883:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787603859.287324:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355192320 00000100:00100000:2.0:1787603859.287334:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355192320 00000100:00100000:2.0:1787603859.287420:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787603859.287431:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:8555:x1874438355192320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603859.287910:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:8555:x1874438355192320:12345-0@lo:502:llog_process_th.0 Request processed in 480us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603859.287919:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787603859.288102:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8555:1874438355192320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787603859.288223:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787603859.288232:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603859.288234:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787603859.288241:0:8555:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ed29010d000 00000020:00000080:3.0:1787603859.288249:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787603859.288356:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8555:1874438355192448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603859.288397:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603859.288423:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787603859.288894:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355192448 00000100:00100000:3.0:1787603859.288900:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355192448 00000100:00100000:3.0:1787603859.288935:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787603859.288943:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:8555:x1874438355192448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603859.289281:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:8555:x1874438355192448:12345-0@lo:502:llog_process_th.0 Request processed in 337us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603859.289289:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787603859.289335:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:8555:1874438355192448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787603859.289360:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603859.289365:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603859.289367:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787603859.289371:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787603859.289444:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787603859.289461:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787603859.289471:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19014bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603859.289482:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19014bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603859.862990:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603860.265123:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603860.265167:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603860.265196:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345726592 00000100:00100000:2.0:1787603860.265208:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345726592 00000100:00100000:0.0:1787603860.265259:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603860.265290:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00100000:0.0:1787603860.265296:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00080000:1.0:1787603860.265346:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603860.265385:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345726592:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603860.265487:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345726592:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 186us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603860.265496:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00100000:2.0:1787603860.265521:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345726464 00000100:00100000:2.0:1787603860.265524:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345726464 00000100:00100000:2.0:1787603860.265550:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 191 00000100:00100000:2.0:1787603860.265557:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2363:x1874438345726464:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603860.265581:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2363:x1874438345726464:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 24us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603860.265587:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 191 00000100:00100000:3.0:1787603860.269539:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345726848 00000100:00100000:3.0:1787603860.269553:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345726848 00000100:00080000:1.0:1787603860.269659:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787603860.274120:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345726720 00000100:00100000:0.0:1787603860.274137:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345726720 00000100:00100000:0.0:1787603860.274210:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:0.0:1787603860.274225:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345726848:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603860.274314:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345726848:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 95us (9147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603860.274322:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:0.0:1787603860.274341:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00100000:0.0:1787603860.274348:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345726720:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603860.274373:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345726720:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 26us (9081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603860.274379:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00080000:1.0:1787603860.274737:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603860.439149:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355192576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603860.439243:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603860.439365:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355192576 00000100:00100000:1.0:1787603860.439374:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355192576 00000100:00080000:2.0:1787603860.439456:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787603860.439460:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787603860.439473:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355192576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787603860.439512:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603860.439570:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355192576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603860.439578:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787603860.439774:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470e00 x1874438355192576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603860.439794:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355192576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787603860.440439:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355192704:0@lo:400:kworker.0 00000100:00100000:2.0:1787603860.440485:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603860.440565:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355192704 00000100:00100000:3.0:1787603860.440571:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355192704 00000100:00100000:3.0:1787603860.440615:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787603860.440624:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355192704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603860.442973:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355193088:0@lo:400:kworker.0 00000100:00100000:1.0:1787603860.443039:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603860.443094:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355193088 00000100:00100000:1.0:1787603860.443101:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355193088 00000100:00100000:1.0:1787603860.443154:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787603860.443164:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355193088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603860.443211:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355193088:12345-0@lo:400:kworker.0 Request processed in 50us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603860.443219:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787603860.443222:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355192704:12345-0@lo:400:kworker.0 Request processed in 2599us (2736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603860.443231:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:1.0:1787603860.443241:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603860.443261:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355192960:0@lo:400:kworker.0 00000100:00100000:1.0:1787603860.443267:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355193088:0@lo:400:kworker.0 00000100:00100000:3.0:1787603860.443284:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603860.443302:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355192832:0@lo:400:kworker.0 00000100:00100000:3.0:1787603860.443660:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355192960 00000100:00100000:1.0:1787603860.443662:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603860.443664:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355192960 00000100:00100000:3.0:1787603860.443687:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355192832 00000100:00100000:3.0:1787603860.443690:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355192832 00000100:00100000:1.0:1787603860.443694:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787603860.443700:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355192960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603860.443707:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787603860.443712:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355192832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603860.443767:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355192960:12345-0@lo:400:kworker.0 Request processed in 67us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603860.443771:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355192832:12345-0@lo:400:kworker.0 Request processed in 59us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603860.443774:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787603860.443776:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787603860.443796:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603860.443799:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355192960:0@lo:400:kworker.0 00000100:00100000:1.0:1787603860.443819:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355192832:0@lo:400:kworker.0 00000100:00100000:2.0:1787603860.443931:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355192704:0@lo:400:kworker.0 00000100:00100000:2.0:1787603860.444632:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355193216:0@lo:400:kworker.0 00000100:00100000:2.0:1787603860.444670:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603860.445100:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355193216 00000100:00100000:3.0:1787603860.445105:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355193216 00000100:00100000:3.0:1787603860.445197:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787603860.445205:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355193216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603860.445258:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355193216:12345-0@lo:400:kworker.0 Request processed in 54us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603860.445265:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787603860.445345:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d4ca80 x1874438355193216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603860.445357:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355193216:0@lo:400:kworker.0 00000100:00080000:1.0:1787603860.445546:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787603860.887391:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603860.953963:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787603860.956701:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355193344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787603860.956786:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603860.958272:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355193344 00000100:00100000:1.0:1787603860.958285:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355193344 00000100:00100000:1.0:1787603860.958352:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787603860.958364:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355193344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787603860.958403:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603860.958498:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355193344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603860.958505:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787603860.959106:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf471f80 x1874438355193344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603860.959130:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355193344:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787603861.922982:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603862.936257:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603863.960377:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787603864.717483:0:8788:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787603864.984645:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603865.394306:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603865.394373:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603865.394426:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345727360 00000100:00100000:0.0:1787603865.394440:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345727360 00000100:00100000:0.0:1787603865.394630:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:1.0:1787603865.394645:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345727104 00000100:00100000:0.0:1787603865.394647:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345727360:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603865.394655:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345727104 00000100:00100000:1.0:1787603865.394706:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 34 00000100:00100000:1.0:1787603865.394715:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345727104:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603865.394794:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345727104:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603865.394803:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 34 00000100:00100000:0.0:1787603865.394823:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345727360:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 178us (447us total) trans 0 rc 0/0 00000100:00080000:1.0:1787603865.394828:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787603865.394833:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787603865.394833:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:1.0:1787603865.395014:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603865.395048:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603865.395077:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345726976 00000100:00100000:1.0:1787603865.395081:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345726976 00000100:00100000:1.0:1787603865.395107:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 193 00000100:00100000:1.0:1787603865.395114:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2363:x1874438345726976:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603865.395140:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2363:x1874438345726976:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 27us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603865.395146:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 193 00000100:00100000:1.0:1787603865.395171:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345727232 00000100:00100000:1.0:1787603865.395175:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345727232 00000100:00100000:1.0:1787603865.395202:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:1.0:1787603865.395209:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345727232:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603865.395232:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345727232:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 25us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603865.395238:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00080000:1.0:1787603865.395254:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787603865.559194:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787603865.559219:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355193472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787603865.559294:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603865.559441:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355193472 00000100:00100000:1.0:1787603865.559449:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355193472 00000100:00100000:1.0:1787603865.559516:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787603865.559525:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355193472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787603865.559561:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603865.559614:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355193472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603865.559621:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787603865.559661:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf471500 x1874438355193472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603865.559692:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355193472:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787603865.559872:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603865.560268:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355193856:0@lo:400:kworker.0 00000100:00100000:3.0:1787603865.560307:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603865.560347:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787603865.560354:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355193984:0@lo:400:kworker.0 00000100:00100000:3.0:1787603865.560376:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603865.560422:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355193856 00000100:00100000:3.0:1787603865.560427:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355193856 00000100:00100000:3.0:1787603865.560458:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355193984 00000100:00100000:3.0:1787603865.560460:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355193984 00000100:00100000:3.0:1787603865.560479:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787603865.560487:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355193856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603865.560527:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355193856:12345-0@lo:400:kworker.0 Request processed in 40us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603865.560534:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787603865.560546:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787603865.560553:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355193984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603865.560581:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355193984:12345-0@lo:400:kworker.0 Request processed in 28us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603865.560586:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787603865.560614:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355193984:0@lo:400:kworker.0 00000100:00100000:3.0:1787603865.560623:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355193856:0@lo:400:kworker.0 00000100:00100000:2.0:1787603865.560855:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355193600:0@lo:400:kworker.0 00000100:00100000:2.0:1787603865.560881:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603865.560904:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355194112:0@lo:400:kworker.0 00000100:00100000:2.0:1787603865.560920:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603865.560937:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787603865.560941:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355193728:0@lo:400:kworker.0 00000100:00100000:2.0:1787603865.560953:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787603865.560968:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603865.560973:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355193728 00000100:00100000:2.0:1787603865.560976:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355193728 00000100:00100000:2.0:1787603865.560991:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787603865.560994:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355193728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603865.561016:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355193728:12345-0@lo:400:kworker.0 Request processed in 21us (62us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603865.561019:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787603865.561035:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355193728:0@lo:400:kworker.0 00000100:00100000:1.0:1787603865.561079:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355194112 00000100:00100000:1.0:1787603865.561082:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355194112 00000100:00100000:1.0:1787603865.561110:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787603865.561115:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355194112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603865.561142:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355194112:12345-0@lo:400:kworker.0 Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603865.561146:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787603865.561170:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf471f80 x1874438355194112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603865.561180:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355194112:0@lo:400:kworker.0 00000100:00080000:2.0:1787603865.561306:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787603865.561346:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355193600 00000100:00100000:3.0:1787603865.561349:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355193600 00000100:00100000:3.0:1787603865.561371:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787603865.561375:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355193600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603865.561686:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355193600:12345-0@lo:400:kworker.0 Request processed in 308us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603865.561694:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787603865.561760:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355193600:0@lo:400:kworker.0 00010000:00010000:1.0:1787603866.012376:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603866.072332:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787603866.072359:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355194240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787603866.072431:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603866.073094:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355194240 00000100:00100000:1.0:1787603866.073104:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355194240 00000100:00100000:1.0:1787603866.073161:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787603866.073172:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355194240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787603866.073207:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603866.073266:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355194240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603866.073273:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787603866.073458:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf471f80 x1874438355194240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603866.073489:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355194240:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787603867.033342:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603868.054954:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603869.078966:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787603869.480670:0:9031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing yml_node 00010000:00010000:0.0:1787603870.107054:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603870.518018:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603870.523594:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603870.523788:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345727488 00000100:00100000:1.0:1787603870.523799:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345727488 00000100:00100000:1.0:1787603870.523925:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 195 00000100:00100000:1.0:1787603870.523937:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2364:x1874438345727488:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603870.524008:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2364:x1874438345727488:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 73us (6004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603870.524015:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 195 00000100:00100000:3.0:1787603870.527518:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603870.527666:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603870.527707:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345727616 00000100:00100000:3.0:1787603870.527717:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345727616 00000100:00100000:3.0:1787603870.527785:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 38 00000100:00100000:3.0:1787603870.527796:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345727616:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603870.527885:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345727616:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (4299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603870.527892:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 38 00000100:00100000:3.0:1787603870.527916:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345727744 00000100:00100000:3.0:1787603870.527920:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345727744 00000100:00100000:3.0:1787603870.527943:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345727872 00000100:00100000:3.0:1787603870.527945:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345727872 00000100:00100000:3.0:1787603870.527962:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:3.0:1787603870.527968:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2362:x1874438345727744:12345-192.168.202.21@tcp:9:kworker.0 00000020:00000080:3.0:1787603870.527995:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19013f9 00000100:00080000:3.0:1787603870.528005:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9ed285c13000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787603870.528061:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787603870.528375:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+2:2362:x1874438345727744:12345-192.168.202.21@tcp:9:kworker.0 Request processed in 406us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603870.528383:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:3.0:1787603870.528395:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:3.0:1787603870.528402:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2362:x1874438345727872:12345-192.168.202.21@tcp:9:kworker.0 00000020:00000080:3.0:1787603870.528415:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901400 00000100:00080000:3.0:1787603870.528421:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9ed285c17000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787603870.528441:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787603870.528607:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+2:2362:x1874438345727872:12345-192.168.202.21@tcp:9:kworker.0 Request processed in 204us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603870.528613:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 11 00010000:00010000:3.0:1787603870.528691:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603870.528697:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787603870.530863:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787603870.530876:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787603870.530879:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603870.680998:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355194368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787603870.681074:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603870.681158:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355194368 00000100:00100000:1.0:1787603870.681165:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355194368 00000100:00100000:1.0:1787603870.681220:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787603870.681229:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355194368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787603870.681265:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603870.681308:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355194368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603870.681316:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787603870.681337:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787603870.681368:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470e00 x1874438355194368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603870.681388:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355194368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603870.681692:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355194496:0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.681728:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603870.681755:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355195008:0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.681779:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603870.681800:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787603870.681805:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355194880:0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.681830:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603870.681879:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355194752:0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.681902:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603870.681922:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787603870.681926:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355194624:0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.681947:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603870.681972:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355194496 00000100:00100000:0.0:1787603870.681977:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355194496 00000100:00100000:0.0:1787603870.682006:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787603870.682027:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355194496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.682063:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355194496:12345-0@lo:400:kworker.0 Request processed in 37us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603870.682069:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787603870.682207:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355195008 00000100:00100000:0.0:1787603870.682212:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355195008 00000100:00100000:0.0:1787603870.682254:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787603870.682260:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355195008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.682294:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355195008:12345-0@lo:400:kworker.0 Request processed in 34us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603870.682299:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787603870.682319:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355194880 00000100:00100000:0.0:1787603870.682323:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355194880 00000100:00100000:0.0:1787603870.682347:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355194752 00000100:00100000:0.0:1787603870.682350:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355194752 00000100:00100000:0.0:1787603870.682365:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355194624 00000100:00100000:0.0:1787603870.682368:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355194624 00000100:00100000:0.0:1787603870.682380:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787603870.682386:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355194880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.682415:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355194880:12345-0@lo:400:kworker.0 Request processed in 29us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603870.682421:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787603870.682433:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787603870.682439:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355194752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.682470:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355194752:12345-0@lo:400:kworker.0 Request processed in 31us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603870.682476:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787603870.682497:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787603870.682503:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355194624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.682532:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355194624:12345-0@lo:400:kworker.0 Request processed in 30us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603870.682538:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787603870.682581:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355194624:0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.682590:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355194752:0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.682610:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355194880:0@lo:400:kworker.0 00000100:00100000:0.0:1787603870.682617:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355194496:0@lo:400:kworker.0 00010000:00080000:0.0:1787603870.682625:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d4dc00 x1874438355195008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603870.682645:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355195008:0@lo:400:kworker.0 00000100:00080000:2.0:1787603870.682693:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787603870.682697:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787603871.128268:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603871.192103:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787603871.198259:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355195136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787603871.198346:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603871.198539:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355195136 00000100:00100000:1.0:1787603871.198549:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355195136 00000100:00100000:1.0:1787603871.198673:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787603871.198684:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355195136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787603871.198723:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603871.198769:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355195136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603871.198776:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787603871.198865:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470e00 x1874438355195136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603871.199518:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355195136:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787603872.154778:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603873.175052:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603874.201114:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787603874.341028:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000020:00000080:1.0:1787603874.341038:0:7632:0:(genops.c:885:class_export_put()) final put ffff9ed285c16000/a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000020:00000080:0.0:1787603874.341102:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed285c16000/a45d6158-dc8e-48e6-b534-483bf3fa20ad for lustre-OST0001 00000020:00000080:0.0:1787603874.341156:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed285c17000 for lustre-OST0001 00000001:00100000:3.0:1787603874.883478:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000020:00000080:3.0:1787603874.883488:0:6705:0:(genops.c:885:class_export_put()) final put ffff9ed285c13800/a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000020:00000080:3.0:1787603874.883519:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed285c13800/a45d6158-dc8e-48e6-b534-483bf3fa20ad for lustre-OST0000 00000020:00000080:3.0:1787603874.883567:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed285c13000 for lustre-OST0000 00000001:02000400:3.0:1787603875.206897:0:9228:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00010000:00010000:3.0:1787603875.232985:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603875.625881:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603875.626141:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345728000 00000100:00100000:0.0:1787603875.626167:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345728000 00000100:00100000:0.0:1787603875.626237:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 197 00000100:00100000:0.0:1787603875.626248:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2365:x1874438345728000:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603875.626328:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2365:x1874438345728000:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603875.626336:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 197 00000100:00100000:2.0:1787603875.630365:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603875.630517:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345728128 00000100:00100000:0.0:1787603875.630527:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345728128 00000100:00100000:0.0:1787603875.630620:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 42 00000100:00100000:0.0:1787603875.630631:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2365:x1874438345728128:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603875.630711:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2365:x1874438345728128:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603875.630718:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 42 00000100:00080000:2.0:1787603875.631864:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787603875.799559:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355195264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603875.799648:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603875.799766:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355195264 00000100:00100000:3.0:1787603875.799775:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355195264 00000100:00100000:3.0:1787603875.799867:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787603875.799878:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355195264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787603875.799927:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603875.799974:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355195264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603875.799981:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787603875.800019:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf471880 x1874438355195264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603875.800039:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355195264:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787603875.800192:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603875.800389:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355195776:0@lo:400:kworker.0 00000100:00100000:3.0:1787603875.800421:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603875.800448:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787603875.800454:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355195648:0@lo:400:kworker.0 00000100:00100000:3.0:1787603875.800476:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603875.800506:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355195776 00000100:00100000:3.0:1787603875.800510:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355195776 00000100:00100000:3.0:1787603875.800543:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355195648 00000100:00100000:3.0:1787603875.800546:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355195648 00000100:00100000:3.0:1787603875.800567:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787603875.800574:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355195776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603875.800622:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355195776:12345-0@lo:400:kworker.0 Request processed in 48us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603875.800628:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787603875.800641:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787603875.800647:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355195648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603875.800674:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355195648:12345-0@lo:400:kworker.0 Request processed in 27us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603875.800689:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787603875.800720:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355195648:0@lo:400:kworker.0 00000100:00100000:3.0:1787603875.800730:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355195776:0@lo:400:kworker.0 00000100:00100000:0.0:1787603875.800791:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355195520:0@lo:400:kworker.0 00000100:00100000:0.0:1787603875.800821:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603875.800865:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787603875.800871:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355195392:0@lo:400:kworker.0 00000100:00100000:0.0:1787603875.800900:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603875.800922:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355195904:0@lo:400:kworker.0 00000100:00100000:0.0:1787603875.800945:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603875.800971:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355195520 00000100:00100000:0.0:1787603875.800974:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355195520 00000100:00100000:0.0:1787603875.801001:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787603875.801008:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355195520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603875.801050:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355195520:12345-0@lo:400:kworker.0 Request processed in 43us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603875.801056:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787603875.801074:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355195392 00000100:00100000:0.0:1787603875.801078:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355195392 00000100:00100000:0.0:1787603875.801101:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787603875.801108:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355195392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603875.801136:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355195392:12345-0@lo:400:kworker.0 Request processed in 29us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603875.801142:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787603875.801176:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355195392:0@lo:400:kworker.0 00000100:00100000:0.0:1787603875.801187:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355195520:0@lo:400:kworker.0 00000100:00100000:1.0:1787603875.801264:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355195904 00000100:00100000:1.0:1787603875.801275:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355195904 00000100:00100000:1.0:1787603875.801320:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787603875.801327:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355195904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603875.801368:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355195904:12345-0@lo:400:kworker.0 Request processed in 42us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603875.801374:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787603875.801390:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787603875.801394:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787603875.801410:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed287b4f100 x1874438355195904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603875.801420:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355195904:0@lo:400:kworker.0 00010000:00010000:3.0:1787603876.246987:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603876.311231:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787603876.311256:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355196032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787603876.311335:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603876.311525:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355196032 00000100:00100000:3.0:1787603876.311534:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355196032 00000100:00100000:3.0:1787603876.311617:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787603876.311627:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355196032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787603876.311660:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603876.311723:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355196032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603876.311730:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787603876.311964:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470000 x1874438355196032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603876.311984:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355196032:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787603877.274547:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787603877.615578:0:9326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00010000:00010000:3.0:1787603878.295161:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603879.321812:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787603880.070298:0:9423:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:0.0:1787603880.349316:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603880.747080:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603880.747134:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603880.747209:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345728256 00000100:00100000:3.0:1787603880.747219:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345728256 00000100:00100000:3.0:1787603880.747283:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 199 00000100:00100000:3.0:1787603880.747293:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2364:x1874438345728256:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603880.747360:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2364:x1874438345728256:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 69us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603880.747367:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 199 00000100:00100000:0.0:1787603880.748499:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345728384 00000100:00100000:0.0:1787603880.748507:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345728384 00000100:00100000:0.0:1787603880.748580:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 46 00000100:00100000:0.0:1787603880.748589:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345728384:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603880.748645:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345728384:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 58us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603880.748652:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 46 00000100:00080000:1.0:1787603880.748797:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603880.923805:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787603880.923868:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355196160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603880.923952:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603880.924137:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355196160 00000100:00100000:1.0:1787603880.924145:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355196160 00000100:00100000:1.0:1787603880.924220:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787603880.924230:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355196160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787603880.924267:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603880.924315:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355196160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603880.924321:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787603880.924396:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787603880.924425:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf473800 x1874438355196160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603880.924445:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355196160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603880.924748:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355196544:0@lo:400:kworker.0 00000100:00100000:0.0:1787603880.924783:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603880.924807:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787603880.924823:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355196416:0@lo:400:kworker.0 00000100:00100000:0.0:1787603880.924874:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603880.924900:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355196544 00000100:00100000:0.0:1787603880.924904:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355196544 00000100:00100000:0.0:1787603880.924938:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355196416 00000100:00100000:0.0:1787603880.924941:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355196416 00000100:00100000:0.0:1787603880.924959:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787603880.924965:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355196544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603880.925001:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355196544:12345-0@lo:400:kworker.0 Request processed in 36us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603880.925007:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787603880.925020:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787603880.925026:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355196416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603880.925051:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355196416:12345-0@lo:400:kworker.0 Request processed in 25us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603880.925056:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787603880.925073:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787603880.925089:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355196416:0@lo:400:kworker.0 00000100:00100000:0.0:1787603880.925098:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355196544:0@lo:400:kworker.0 00000100:00100000:3.0:1787603880.925181:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355196288:0@lo:400:kworker.0 00000100:00100000:3.0:1787603880.925211:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603880.925244:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355196800:0@lo:400:kworker.0 00000100:00100000:3.0:1787603880.925267:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603880.925287:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787603880.925293:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355196672:0@lo:400:kworker.0 00000100:00100000:3.0:1787603880.925313:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603880.925338:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355196800 00000100:00100000:3.0:1787603880.925342:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355196800 00000100:00100000:3.0:1787603880.925373:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787603880.925379:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355196800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603880.925414:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355196800:12345-0@lo:400:kworker.0 Request processed in 35us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603880.925420:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787603880.925434:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787603880.925441:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355196672 00000100:00100000:3.0:1787603880.925444:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355196672 00000100:00100000:3.0:1787603880.925468:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787603880.925473:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355196672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603880.925503:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355196672:12345-0@lo:400:kworker.0 Request processed in 30us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603880.925509:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787603880.925551:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603880.925570:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355196672:0@lo:400:kworker.0 00010000:00080000:3.0:1787603880.925581:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2ba36c000 x1874438355196800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603880.925590:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355196800:0@lo:400:kworker.0 00000100:00100000:0.0:1787603880.927697:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355196288 00000100:00100000:0.0:1787603880.927711:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355196288 00000100:00100000:0.0:1787603880.927779:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787603880.927790:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355196288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603880.927918:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355196288:12345-0@lo:400:kworker.0 Request processed in 131us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603880.927926:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787603880.928054:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355196288:0@lo:400:kworker.0 00010000:00010000:3.0:1787603881.367200:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603881.433342:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787603881.433366:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355196928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787603881.433440:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603881.433929:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355196928 00000100:00100000:1.0:1787603881.433938:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355196928 00000100:00100000:1.0:1787603881.434003:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787603881.434013:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355196928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787603881.434049:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603881.434107:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355196928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603881.434115:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787603881.434154:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470a80 x1874438355196928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603881.434171:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355196928:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787603881.910603:0:9471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 16:38:00 EDT 2026 00010000:00010000:3.0:1787603882.391248:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603883.429009:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603884.439035:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603885.466962:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603885.866993:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603885.867050:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603885.867089:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345728640 00000100:00100000:2.0:1787603885.867102:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345728640 00000100:00100000:3.0:1787603885.867116:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345728512 00000100:00100000:3.0:1787603885.867120:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345728512 00000100:00100000:3.0:1787603885.867175:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 201 00000100:00100000:2.0:1787603885.867175:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 50 00000100:00100000:3.0:1787603885.867186:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2365:x1874438345728512:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603885.867186:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2365:x1874438345728640:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603885.867275:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2365:x1874438345728512:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603885.867285:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 201 00000100:00080000:3.0:1787603885.867359:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603885.876932:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2365:x1874438345728640:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 9729us (9862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603885.876950:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 50 00000100:00100000:2.0:1787603886.040119:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355197440:0@lo:400:kworker.0 00000100:00100000:2.0:1787603886.040221:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603886.040303:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787603886.040314:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355197056:0@lo:400:kworker.0 00000100:00100000:2.0:1787603886.041297:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603886.041441:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355197568:0@lo:400:kworker.0 00000100:00100000:2.0:1787603886.041691:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603886.041746:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355197184:0@lo:400:kworker.0 00000100:00100000:2.0:1787603886.041800:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603886.041830:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355197696:0@lo:400:kworker.0 00000100:00100000:2.0:1787603886.041885:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603886.041920:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787603886.041927:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355197312:0@lo:400:kworker.0 00000100:00100000:2.0:1787603886.041949:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603886.041984:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355197056 00000100:00100000:2.0:1787603886.041992:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355197056 00000100:00100000:2.0:1787603886.042038:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787603886.042049:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355197056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603886.042122:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355197056:12345-0@lo:400:kworker.0 Request processed in 74us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603886.042131:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787603886.042169:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355197568 00000100:00100000:2.0:1787603886.042174:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355197568 00000100:00100000:2.0:1787603886.042207:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355197184 00000100:00100000:2.0:1787603886.042210:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355197184 00000100:00100000:2.0:1787603886.042222:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355197312 00000100:00100000:2.0:1787603886.042224:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355197312 00000100:00100000:2.0:1787603886.042240:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787603886.042258:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355197568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603886.042301:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355197568:12345-0@lo:400:kworker.0 Request processed in 47us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603886.042308:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787603886.042322:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787603886.042329:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355197184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603886.043348:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355197440 00000100:00100000:0.0:1787603886.043362:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355197440 00000100:00100000:0.0:1787603886.043420:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355197696 00000100:00100000:0.0:1787603886.043424:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355197696 00000100:00100000:0.0:1787603886.043448:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787603886.043459:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355197440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603886.043571:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787603886.043583:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355197312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603886.045271:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355197184:12345-0@lo:400:kworker.0 Request processed in 2932us (3460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603886.045287:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787603886.045324:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355197440:12345-0@lo:400:kworker.0 Request processed in 1862us (5102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603886.045341:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787603886.045377:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787603886.045391:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355197696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603886.045870:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355197056:0@lo:400:kworker.0 00000100:00100000:2.0:1787603886.045900:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355197568:0@lo:400:kworker.0 00000100:00100000:3.0:1787603886.045911:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355197312:12345-0@lo:400:kworker.0 Request processed in 2324us (3953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603886.045924:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787603886.045927:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d50000 x1874438355197440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603886.045941:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355197440:0@lo:400:kworker.0 00000100:00080000:3.0:1787603886.046010:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787603886.046019:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787603886.046022:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355197312:0@lo:400:kworker.0 00000100:00080000:3.0:1787603886.046025:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603886.046051:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355197184:0@lo:400:kworker.0 00000100:00100000:3.0:1787603886.046061:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355197824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603886.046117:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603886.046529:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355197824 00000100:00100000:1.0:1787603886.046538:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355197824 00000100:00100000:1.0:1787603886.046592:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787603886.046603:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355197824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787603886.046646:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603886.046698:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355197824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603886.046706:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787603886.047767:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470a80 x1874438355197824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603886.047792:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355197824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603886.048373:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355197696:12345-0@lo:400:kworker.0 Request processed in 2978us (6478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603886.048390:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787603886.049008:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d51f80 x1874438355197696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603886.049025:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355197696:0@lo:400:kworker.0 00010000:00010000:0.0:1787603886.487126:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603886.551070:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787603886.555288:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355197952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787603886.555373:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603886.555696:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355197952 00000100:00100000:1.0:1787603886.555704:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355197952 00000100:00100000:1.0:1787603886.555753:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787603886.555761:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355197952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787603886.555807:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603886.555877:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355197952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603886.555884:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787603886.556155:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470700 x1874438355197952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603886.556173:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355197952:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787603887.510974:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603888.535907:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603889.559122:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603890.584658:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603890.991684:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603890.991727:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603890.991759:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345728768 00000100:00100000:2.0:1787603890.991769:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345728768 00000100:00100000:2.0:1787603890.991814:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 203 00000100:00100000:2.0:1787603890.991825:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2363:x1874438345728768:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603890.991902:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2363:x1874438345728768:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603890.991909:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 203 00000100:00100000:0.0:1787603890.992105:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345728896 00000100:00100000:0.0:1787603890.992110:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345728896 00000100:00100000:0.0:1787603890.992164:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 54 00000100:00100000:0.0:1787603890.992172:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345728896:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603890.992211:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345728896:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 40us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603890.992218:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 54 00000100:00080000:2.0:1787603890.992476:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603891.159016:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355198080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787603891.159087:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603891.159163:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355198080 00000100:00100000:2.0:1787603891.159170:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355198080 00000100:00100000:2.0:1787603891.159225:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787603891.159234:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355198080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787603891.159269:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787603891.159326:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355198080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603891.159334:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787603891.159354:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787603891.159383:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed286af2300 x1874438355198080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603891.159401:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355198080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603891.159555:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355198336:0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.159587:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603891.159608:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787603891.159613:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355198208:0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.159640:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603891.159659:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355198720:0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.159678:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603891.159701:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355198336 00000100:00100000:3.0:1787603891.159705:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355198336 00000100:00100000:3.0:1787603891.159730:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787603891.159736:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355198336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.159769:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355198336:12345-0@lo:400:kworker.0 Request processed in 33us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603891.159775:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787603891.159792:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355198208 00000100:00100000:3.0:1787603891.159795:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355198208 00000100:00100000:3.0:1787603891.159815:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787603891.159820:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355198208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.159868:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355198208:12345-0@lo:400:kworker.0 Request processed in 47us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603891.159874:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787603891.159897:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355198720 00000100:00100000:3.0:1787603891.159901:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355198720 00000100:00100000:3.0:1787603891.159928:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787603891.159933:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355198720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.159970:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355198720:12345-0@lo:400:kworker.0 Request processed in 37us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603891.159976:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787603891.160001:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355198464:0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.160022:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603891.160042:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787603891.160047:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355198592:0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.160065:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603891.160087:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355198464 00000100:00100000:3.0:1787603891.160090:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355198464 00000100:00100000:3.0:1787603891.160111:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355198592 00000100:00100000:3.0:1787603891.160113:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355198592 00000100:00100000:3.0:1787603891.160128:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787603891.160134:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355198464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.160164:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355198464:12345-0@lo:400:kworker.0 Request processed in 30us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603891.160169:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787603891.160180:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787603891.160186:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355198592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.160209:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355198592:12345-0@lo:400:kworker.0 Request processed in 23us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603891.160214:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1787603891.160230:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787603891.160232:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787603891.160247:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355198592:0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.160255:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355198464:0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.160287:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355198208:0@lo:400:kworker.0 00010000:00080000:3.0:1787603891.160296:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed287b4c700 x1874438355198720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603891.160304:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355198720:0@lo:400:kworker.0 00000100:00100000:3.0:1787603891.160311:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355198336:0@lo:400:kworker.0 00010000:00010000:0.0:1787603891.607154:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603891.671574:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787603891.671596:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355198848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787603891.671668:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603891.672683:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355198848 00000100:00100000:1.0:1787603891.672694:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355198848 00000100:00100000:1.0:1787603891.672751:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787603891.672762:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355198848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787603891.672813:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603891.672902:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355198848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603891.672910:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787603891.672994:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf472d80 x1874438355198848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603891.673017:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355198848:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787603892.632625:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603893.656434:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603894.680558:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603895.703218:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603896.108065:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603896.108114:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603896.108210:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345729152 00000100:00100000:1.0:1787603896.108221:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345729152 00000100:00100000:1.0:1787603896.108287:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 58 00000100:00100000:1.0:1787603896.108298:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345729152:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603896.108371:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345729152:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 75us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603896.108379:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 58 00000100:00080000:1.0:1787603896.108400:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603896.108589:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345729024 00000100:00100000:3.0:1787603896.108594:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345729024 00000100:00100000:3.0:1787603896.108628:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 205 00000100:00100000:3.0:1787603896.108636:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2364:x1874438345729024:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603896.108676:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2364:x1874438345729024:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 40us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603896.108682:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 205 00000100:00100000:0.0:1787603896.279246:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355199104:0@lo:400:kworker.0 00000100:00100000:0.0:1787603896.279321:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603896.279391:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787603896.279398:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355198976:0@lo:400:kworker.0 00000100:00100000:0.0:1787603896.279438:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603896.279478:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355199104 00000100:00100000:0.0:1787603896.279486:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355199104 00000100:00100000:0.0:1787603896.279531:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787603896.279540:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355199104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603896.279609:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355199104:12345-0@lo:400:kworker.0 Request processed in 69us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603896.279616:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787603896.279640:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355198976 00000100:00100000:0.0:1787603896.279644:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355198976 00000100:00100000:0.0:1787603896.279667:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787603896.279673:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355198976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603896.279702:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355198976:12345-0@lo:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603896.279708:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787603896.279751:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355198976:0@lo:400:kworker.0 00000100:00100000:0.0:1787603896.279777:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355199104:0@lo:400:kworker.0 00000100:00100000:3.0:1787603896.280090:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355199360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603896.280128:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603896.280169:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787603896.280176:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355199232:0@lo:400:kworker.0 00000100:00100000:3.0:1787603896.280201:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603896.280220:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355199744:0@lo:400:kworker.0 00000100:00100000:3.0:1787603896.280244:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603896.280270:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355199488:0@lo:400:kworker.0 00000100:00100000:3.0:1787603896.280290:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603896.280307:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787603896.280312:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355199616:0@lo:400:kworker.0 00000100:00100000:3.0:1787603896.280345:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603896.280371:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355199744 00000100:00100000:3.0:1787603896.280375:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355199744 00000100:00100000:3.0:1787603896.280421:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355199488 00000100:00100000:3.0:1787603896.280425:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355199488 00000100:00100000:3.0:1787603896.280443:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787603896.280450:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355199744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603896.280488:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355199744:12345-0@lo:400:kworker.0 Request processed in 38us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603896.280494:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787603896.280507:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787603896.280514:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355199488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603896.280546:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355199488:12345-0@lo:400:kworker.0 Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603896.280551:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787603896.280582:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed286af2a00 x1874438355199488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603896.280594:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355199488:0@lo:400:kworker.0 00010000:00080000:3.0:1787603896.280618:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed286af1180 x1874438355199744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603896.280627:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355199744:0@lo:400:kworker.0 00000100:00100000:2.0:1787603896.281068:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355199360 00000100:00100000:2.0:1787603896.281075:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355199360 00000100:00100000:2.0:1787603896.281114:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787603896.281122:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355199360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787603896.281158:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787603896.281214:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355199360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603896.281221:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787603896.281256:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355199232 00000100:00100000:2.0:1787603896.281260:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355199232 00000100:00100000:2.0:1787603896.281284:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355199616 00000100:00100000:2.0:1787603896.281287:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355199616 00000100:00100000:2.0:1787603896.281303:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787603896.281309:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355199232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603896.281341:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355199232:12345-0@lo:400:kworker.0 Request processed in 32us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603896.281347:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787603896.281359:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787603896.281365:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355199616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603896.281395:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355199616:12345-0@lo:400:kworker.0 Request processed in 30us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603896.281400:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1787603896.281439:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787603896.281444:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787603896.281446:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787603896.281579:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355199232:0@lo:400:kworker.0 00010000:00080000:0.0:1787603896.281592:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf472d80 x1874438355199360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603896.281607:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355199360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603896.282277:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355199616:0@lo:400:kworker.0 00010000:00010000:2.0:1787603896.727269:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603896.791443:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355199872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787603896.791517:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603896.791640:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355199872 00000100:00100000:1.0:1787603896.791648:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355199872 00000100:00100000:1.0:1787603896.791706:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787603896.791717:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355199872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787603896.791763:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603896.791831:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355199872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603896.791858:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787603896.792169:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470700 x1874438355199872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603896.792202:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355199872:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787603897.751788:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787603898.461061:0:10100:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:38:16 (1787603896) === 00010000:00010000:2.0:1787603898.780428:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603898.898183:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603898.898292:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345729280 00000100:00100000:2.0:1787603898.898301:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345729280 00000100:00100000:2.0:1787603898.898361:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 207 00000100:00100000:2.0:1787603898.898370:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+10:8136:x1874438345729280:12345-192.168.202.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787603898.898395:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603898.898416:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19014c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5947 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603898.898444:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19014c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5947 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603898.898455:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19014c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5947 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603898.898464:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217c400, rc 0) 00000100:00100000:2.0:1787603898.898518:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+11:8136:x1874438345729280:12345-192.168.202.21@tcp:101:mount.lustre.0 Request processed in 149us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603898.898528:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 207 00000100:00100000:1.0:1787603898.900371:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603898.900589:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345729408 00000100:00100000:0.0:1787603898.900609:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345729408 00000100:00100000:0.0:1787603898.900656:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 208 00000100:00100000:0.0:1787603898.900665:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+11:8136:x1874438345729408:12345-192.168.202.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787603898.900956:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+11:8136:x1874438345729408:12345-192.168.202.21@tcp:501:mount.lustre.0 Request processed in 292us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603898.900963:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 208 00000100:00100000:1.0:1787603898.902895:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603898.902991:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345729536 00000100:00100000:0.0:1787603898.902998:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345729536 00000100:00100000:0.0:1787603898.903038:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 209 00000100:00100000:0.0:1787603898.903047:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+11:8136:x1874438345729536:12345-192.168.202.21@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787603898.903239:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+11:8136:x1874438345729536:12345-192.168.202.21@tcp:503:mount.lustre.0 Request processed in 192us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603898.903247:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 209 00000100:00100000:1.0:1787603898.914624:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603898.914970:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345729664 00000100:00100000:2.0:1787603898.914983:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345729664 00000100:00100000:2.0:1787603898.915214:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 210 00000100:00100000:2.0:1787603898.915234:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+11:8139:x1874438345729664:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787603898.915637:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+11:8139:x1874438345729664:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 404us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603898.915646:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 210 00000100:00100000:1.0:1787603898.931483:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603898.931657:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345729792 00000100:00100000:0.0:1787603898.931683:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345729792 00000100:00100000:0.0:1787603898.931756:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 211 00000100:00100000:0.0:1787603898.931770:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+11:8139:x1874438345729792:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787603898.932201:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+11:8139:x1874438345729792:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 431us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603898.932212:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 211 00000100:00100000:1.0:1787603898.944575:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603898.945082:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345729920 00000100:00100000:2.0:1787603898.945106:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345729920 00000100:00100000:2.0:1787603898.945944:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 212 00000100:00100000:2.0:1787603898.945961:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+11:8136:x1874438345729920:12345-192.168.202.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787603898.945984:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603898.946009:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a19014cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5971 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603898.946047:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a19014cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5971 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603898.946061:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a19014cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5971 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603898.946073:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217ce00, rc 0) 00000100:00100000:2.0:1787603898.946176:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+12:8136:x1874438345729920:12345-192.168.202.21@tcp:101:mount.lustre.0 Request processed in 220us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603898.946184:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 212 00000100:00100000:1.0:1787603898.951998:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603898.962502:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345730048 00000100:00100000:0.0:1787603898.962523:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345730048 00000100:00100000:0.0:1787603898.962618:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 213 00000100:00100000:0.0:1787603898.962631:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+12:8136:x1874438345730048:12345-192.168.202.21@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787603898.962668:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787603898.962769:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787603898.962774:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787603898.962777:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787603898.962779:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787603898.967752:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+12:8136:x1874438345730048:12345-192.168.202.21@tcp:256:mount.lustre.0 Request processed in 5038us (15684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603898.967772:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 213 00000100:00100000:1.0:1787603898.975528:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603898.975644:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345730176 00000100:00100000:2.0:1787603898.975659:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345730176 00000100:00100000:2.0:1787603898.975890:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 214 00000100:00100000:2.0:1787603898.975905:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+12:8136:x1874438345730176:12345-192.168.202.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787603898.975928:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603898.975982:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a19014d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5978 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603898.976020:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a19014d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5978 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603898.976034:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a19014d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5978 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603898.976052:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963e00, rc 0) 00000100:00100000:2.0:1787603898.976141:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:8136:x1874438345730176:12345-192.168.202.21@tcp:101:mount.lustre.0 Request processed in 239us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603898.976149:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 214 00000100:00100000:1.0:1787603898.993109:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603898.993259:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345730304 00000100:00100000:0.0:1787603898.993272:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345730304 00000100:00100000:0.0:1787603898.993342:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 215 00000100:00100000:0.0:1787603898.993353:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:8136:x1874438345730304:12345-192.168.202.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787603898.993730:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:8136:x1874438345730304:12345-192.168.202.21@tcp:501:mount.lustre.0 Request processed in 376us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603898.993739:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 215 00000100:00100000:1.0:1787603899.002141:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603899.002820:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345730432 00000100:00100000:0.0:1787603899.002876:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345730432 00000100:00100000:0.0:1787603899.002954:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 216 00000100:00100000:0.0:1787603899.002967:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:8136:x1874438345730432:12345-192.168.202.21@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787603899.003268:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:8136:x1874438345730432:12345-192.168.202.21@tcp:503:mount.lustre.0 Request processed in 303us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603899.003277:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 216 00000100:00100000:1.0:1787603899.012565:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603899.012691:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345730560 00000100:00100000:3.0:1787603899.012702:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345730560 00000100:00100000:3.0:1787603899.012768:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 217 00000100:00100000:3.0:1787603899.012778:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:8143:x1874438345730560:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787603899.013063:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:8143:x1874438345730560:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 285us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603899.013072:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 217 00000100:00100000:1.0:1787603899.021397:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603899.021570:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345730688 00000100:00100000:2.0:1787603899.021587:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345730688 00000100:00100000:2.0:1787603899.021669:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 218 00000100:00100000:2.0:1787603899.021684:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:8143:x1874438345730688:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787603899.022300:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:8143:x1874438345730688:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 613us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603899.022313:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 218 00000100:00100000:1.0:1787603899.042903:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603899.042933:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603899.042998:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345731200 00000100:00100000:3.0:1787603899.043006:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345731200 00000100:00100000:3.0:1787603899.043071:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345730816 00000100:00100000:3.0:1787603899.043074:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345730816 00000100:00080000:1.0:1787603899.043135:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603899.043187:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 62 00000100:00100000:2.0:1787603899.043219:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2365:x1874438345731200:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603899.043355:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2365:x1874438345731200:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 151us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603899.046140:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:3.0:1787603899.046155:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2362:x1874438345730816:12345-192.168.202.21@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787603899.046191:0:5821:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 649d83ee-97a0-4141-af13-8dc5b7a4524e@192.168.202.21@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1787603899.046398:0:5821:0:(genops.c:1385:class_connect()) connect: client 649d83ee-97a0-4141-af13-8dc5b7a4524e, cookie 0xb5d1f3b1a19014d9 00000004:00100000:3.0:1787603899.046433:0:5821:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1787603899.046703:0:5821:0:(import.c:65:import_set_state_nolock()) ffff9ed2ba360800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787603899.046794:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:2362:x1874438345730816:12345-192.168.202.21@tcp:38:mount.lustre.0 Request processed in 639us (3857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603899.046803:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:2.0:1787603899.050617:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 62 00000100:00100000:3.0:1787603899.051560:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603899.051652:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345730944 00000100:00100000:2.0:1787603899.051668:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345730944 00000100:00100000:2.0:1787603899.051773:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:2.0:1787603899.051786:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:0:x1874438345730944:12345-192.168.202.21@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787603899.051999:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787603899.052117:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:0:x1874438345730944:12345-192.168.202.21@tcp:41:mount.lustre.0 Request processed in 333us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603899.052125:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00080000:3.0:1787603899.052675:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787603899.052726:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603899.052923:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345731072 00000100:00100000:3.0:1787603899.052935:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345731072 00000100:00100000:3.0:1787603899.052998:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:3.0:1787603899.053013:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:8136:x1874438345731072:12345-192.168.202.21@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787603899.053060:0:7875:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787603899.053144:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:8136:x1874438345731072:12345-192.168.202.21@tcp:41:mount.lustre.0 Request processed in 135us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603899.053152:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:0.0:1787603899.059103:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603899.059375:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345731328 00000100:00100000:1.0:1787603899.059402:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345731328 00000100:00100000:1.0:1787603899.059696:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:1.0:1787603899.059707:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:8136:x1874438345731328:12345-192.168.202.21@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787603899.059820:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:8136:x1874438345731328:12345-192.168.202.21@tcp:40:mount.lustre.0 Request processed in 107us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603899.059828:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:3.0:1787603899.066529:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603899.067421:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345731712 00000100:00100000:2.0:1787603899.067447:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345731712 00000100:00100000:2.0:1787603899.067549:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1 00000100:00100000:2.0:1787603899.067582:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:8136:x1874438345731712:12345-192.168.202.21@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787603899.067987:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787603899.071663:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:8136:x1874438345731712:12345-192.168.202.21@tcp:33:mount.lustre.0 Request processed in 4066us (5131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603899.071702:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1 00000100:00100000:0.0:1787603899.072391:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603899.072875:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345731456 00000100:00100000:3.0:1787603899.072889:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345731456 00000100:00100000:3.0:1787603899.073022:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:3.0:1787603899.073032:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1874438345731456:12345-192.168.202.21@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787603899.073071:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 649d83ee-97a0-4141-af13-8dc5b7a4524e@192.168.202.21@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1787603899.073460:0:6676:0:(genops.c:1385:class_connect()) connect: client 649d83ee-97a0-4141-af13-8dc5b7a4524e, cookie 0xb5d1f3b1a19014e0 00002000:00100000:3.0:1787603899.073479:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 649d83ee-97a0-4141-af13-8dc5b7a4524e/ffff9ed2ba364800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787603899.073514:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787603899.073799:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787603899.076572:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9ed2ba363000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787603899.077042:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:2362:x1874438345731456:12345-192.168.202.21@tcp:8:mount.lustre.0 Request processed in 4003us (4946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603899.077057:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:0.0:1787603899.079480:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603899.080434:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345731584 00000100:00100000:2.0:1787603899.080452:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345731584 00000100:00100000:2.0:1787603899.080515:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:2.0:1787603899.080527:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874438345731584:12345-192.168.202.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787603899.080569:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 649d83ee-97a0-4141-af13-8dc5b7a4524e@192.168.202.21@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:2.0:1787603899.080608:0:6679:0:(genops.c:1385:class_connect()) connect: client 649d83ee-97a0-4141-af13-8dc5b7a4524e, cookie 0xb5d1f3b1a19014e7 00002000:00100000:2.0:1787603899.080625:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 649d83ee-97a0-4141-af13-8dc5b7a4524e/ffff9ed1835be800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787603899.080660:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787603899.081741:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787603899.081804:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9ed1835ba000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787603899.082622:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:2362:x1874438345731584:12345-192.168.202.21@tcp:8:mount.lustre.0 Request processed in 2090us (3150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603899.082636:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 13 00010000:00010000:2.0:1787603899.799243:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787603899.964628:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 649d83ee-97a0-4141-af13-8dc5b7a4524e 00000001:00100000:2.0:1787603900.441209:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 649d83ee-97a0-4141-af13-8dc5b7a4524e 00010000:00010000:0.0:1787603900.824004:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787603900.997934:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 649d83ee-97a0-4141-af13-8dc5b7a4524e 00000100:00100000:1.0:1787603901.399196:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355200256:0@lo:400:kworker.0 00000100:00100000:1.0:1787603901.399287:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603901.399351:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787603901.399365:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355200384:0@lo:400:kworker.0 00000100:00100000:1.0:1787603901.399391:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603901.399428:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355200256 00000100:00100000:1.0:1787603901.399435:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355200256 00000100:00100000:1.0:1787603901.399491:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787603901.399502:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355200256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603901.399561:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355200256:12345-0@lo:400:kworker.0 Request processed in 60us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603901.399569:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787603901.399594:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355200384 00000100:00100000:1.0:1787603901.399598:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355200384 00000100:00100000:1.0:1787603901.399626:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787603901.399631:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355200384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603901.399660:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355200384:12345-0@lo:400:kworker.0 Request processed in 29us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603901.399666:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787603901.399680:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787603901.399684:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787603901.399711:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf471f80 x1874438355200384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603901.399725:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355200384:0@lo:400:kworker.0 00000100:00100000:1.0:1787603901.399736:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355200256:0@lo:400:kworker.0 00000100:00100000:1.0:1787603901.404290:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355200768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787603901.404355:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603901.404433:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355200768 00000100:00100000:1.0:1787603901.404441:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355200768 00000100:00100000:1.0:1787603901.404492:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787603901.404501:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355200768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787603901.404536:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603901.404580:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355200768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603901.404598:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787603901.404642:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470e00 x1874438355200768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603901.404661:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355200768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603901.406782:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355200128:0@lo:400:kworker.0 00000100:00100000:0.0:1787603901.406881:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603901.406914:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355200640:0@lo:400:kworker.0 00000100:00100000:0.0:1787603901.406937:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603901.406975:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787603901.406983:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355200000:0@lo:400:kworker.0 00000100:00100000:0.0:1787603901.407012:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603901.407033:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355200512:0@lo:400:kworker.0 00000100:00100000:0.0:1787603901.407054:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603901.407088:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355200640 00000100:00100000:0.0:1787603901.407095:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355200640 00000100:00100000:0.0:1787603901.407145:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787603901.407154:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355200640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603901.407200:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355200640:12345-0@lo:400:kworker.0 Request processed in 47us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603901.407206:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787603901.407228:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355200128 00000100:00100000:0.0:1787603901.407231:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355200128 00000100:00100000:0.0:1787603901.407252:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355200512 00000100:00100000:0.0:1787603901.407255:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355200512 00000100:00100000:0.0:1787603901.407276:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787603901.407282:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355200128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603901.407311:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355200128:12345-0@lo:400:kworker.0 Request processed in 29us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603901.407316:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787603901.407329:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787603901.407334:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355200512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603901.415390:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355200512:12345-0@lo:400:kworker.0 Request processed in 8046us (8324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603901.415405:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787603901.415465:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355200000 00000100:00100000:0.0:1787603901.415474:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355200000 00000100:00100000:0.0:1787603901.415523:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787603901.415532:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355200000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603901.415580:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355200000:12345-0@lo:400:kworker.0 Request processed in 49us (8568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603901.415586:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787603901.415634:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355200000:0@lo:400:kworker.0 00000100:00100000:0.0:1787603901.415650:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355200512:0@lo:400:kworker.0 00000100:00100000:0.0:1787603901.415664:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355200128:0@lo:400:kworker.0 00010000:00080000:0.0:1787603901.415677:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf473b80 x1874438355200640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603901.415687:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355200640:0@lo:400:kworker.0 00000100:00080000:0.0:1787603901.415721:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787603901.415727:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787603901.848722:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603901.911974:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787603901.911999:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355200896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787603901.912077:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603901.912143:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355200896 00000100:00100000:0.0:1787603901.912151:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355200896 00000100:00100000:0.0:1787603901.912202:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787603901.912223:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355200896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787603901.912260:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603901.912308:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355200896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603901.912315:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787603901.912368:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2c1b1df80 x1874438355200896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603901.912385:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355200896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787603902.871638:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603903.904409:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603904.301018:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603904.301077:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603904.301114:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603904.301177:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603904.301217:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603904.301257:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345732352 00000100:00100000:0.0:1787603904.301269:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345732352 00000100:00100000:0.0:1787603904.301359:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345732224 00000100:00100000:0.0:1787603904.301364:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345732224 00000100:00100000:0.0:1787603904.301394:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 29 00000100:00100000:0.0:1787603904.301410:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345732352:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603904.301415:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345731840 00000100:00100000:3.0:1787603904.301419:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345731840 00000100:00100000:3.0:1787603904.301462:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 220 00000100:00100000:3.0:1787603904.301471:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345731840:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603904.301508:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345732352:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 104us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603904.301512:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345731840:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 44us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603904.301517:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 29 00000100:00100000:3.0:1787603904.301518:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 220 00000100:00100000:0.0:1787603904.301539:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00100000:0.0:1787603904.301546:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345732224:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603904.301582:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345732224:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 37us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603904.301589:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00100000:0.0:1787603904.301612:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345732096 00000100:00100000:0.0:1787603904.301616:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345732096 00000100:00100000:0.0:1787603904.301655:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345731968 00000100:00100000:0.0:1787603904.301659:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345731968 00000100:00100000:0.0:1787603904.301683:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 66 00000100:00100000:0.0:1787603904.301691:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345732096:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603904.301713:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 67 00000100:00100000:3.0:1787603904.301722:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2365:x1874438345731968:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603904.301722:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345732096:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603904.301729:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 66 00000100:00100000:3.0:1787603904.301748:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2365:x1874438345731968:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00080000:0.0:1787603904.301750:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603904.301755:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 67 00000100:00080000:0.0:1787603904.301755:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787603904.301757:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1787603904.761554:0:10298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787603904.921480:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603905.943607:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603906.519351:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355201152:0@lo:400:kworker.0 00000100:00100000:1.0:1787603906.519454:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603906.519582:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355201024:0@lo:400:kworker.0 00000100:00100000:2.0:1787603906.519626:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603906.519695:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355201664:0@lo:400:kworker.0 00000100:00100000:1.0:1787603906.519752:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603906.519807:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355201152 00000100:00100000:1.0:1787603906.519816:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355201152 00000100:00100000:1.0:1787603906.519895:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787603906.519905:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355201152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603906.519967:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355201152:12345-0@lo:400:kworker.0 Request processed in 62us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603906.519974:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787603906.520000:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355201664 00000100:00100000:1.0:1787603906.520004:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355201664 00000100:00100000:1.0:1787603906.520058:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787603906.520065:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355201664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603906.520099:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355201664:12345-0@lo:400:kworker.0 Request processed in 35us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603906.520105:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787603906.520129:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787603906.520166:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355201152:0@lo:400:kworker.0 00010000:00080000:1.0:1787603906.520181:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf470700 x1874438355201664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603906.520200:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355201664:0@lo:400:kworker.0 00000100:00100000:0.0:1787603906.523060:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355201280:0@lo:400:kworker.0 00000100:00100000:0.0:1787603906.525395:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603906.525523:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355201280 00000100:00100000:1.0:1787603906.525536:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355201280 00000100:00100000:1.0:1787603906.525619:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787603906.525632:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355201280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603906.525726:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355201280:12345-0@lo:400:kworker.0 Request processed in 96us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603906.525734:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787603906.525764:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603906.526234:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355201408:0@lo:400:kworker.0 00000100:00100000:2.0:1787603906.526291:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603906.526357:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355201024 00000100:00100000:2.0:1787603906.526363:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355201024 00000100:00100000:2.0:1787603906.526417:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787603906.526425:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355201024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603906.526466:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355201024:12345-0@lo:400:kworker.0 Request processed in 42us (6839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603906.526474:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787603906.526508:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355201536:0@lo:400:kworker.0 00000100:00100000:2.0:1787603906.526539:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603906.526580:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355201024:0@lo:400:kworker.0 00000100:00100000:1.0:1787603906.527247:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355201408 00000100:00100000:1.0:1787603906.527254:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355201408 00000100:00100000:1.0:1787603906.527322:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787603906.527331:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355201408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603906.527387:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355201408:12345-0@lo:400:kworker.0 Request processed in 58us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603906.527395:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787603906.527416:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355201536 00000100:00100000:1.0:1787603906.527420:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355201536 00000100:00100000:1.0:1787603906.527449:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787603906.527457:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355201536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603906.527502:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355201536:12345-0@lo:400:kworker.0 Request processed in 46us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603906.527508:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1787603906.527549:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf471500 x1874438355201408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603906.527579:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355201408:0@lo:400:kworker.0 00000100:00080000:3.0:1787603906.527637:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787603906.527643:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787603906.527697:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355201536:0@lo:400:kworker.0 00000100:00100000:0.0:1787603906.531956:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355201280:0@lo:400:kworker.0 00000100:00100000:0.0:1787603906.531979:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355201792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603906.533289:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603906.533536:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355201792 00000100:00100000:3.0:1787603906.533547:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355201792 00000100:00100000:3.0:1787603906.533619:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787603906.533632:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355201792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787603906.533686:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603906.533757:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355201792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603906.533765:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787603906.533811:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed286af1880 x1874438355201792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603906.533832:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355201792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787603906.967211:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603907.031326:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787603907.034737:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355201920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787603907.034869:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603907.035153:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355201920 00000100:00100000:0.0:1787603907.035165:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355201920 00000100:00100000:0.0:1787603907.035242:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787603907.035255:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355201920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787603907.035326:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603907.035397:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355201920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603907.035406:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787603907.035562:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b6138a80 x1874438355201920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603907.035587:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355201920:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787603907.991409:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603909.018004:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603909.432515:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603909.432583:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603909.432613:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603909.432645:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603909.432669:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603909.432694:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345732736 00000100:00100000:3.0:1787603909.432703:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345732736 00000100:00100000:3.0:1787603909.432754:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345732608 00000100:00100000:3.0:1787603909.432756:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345732608 00000100:00100000:3.0:1787603909.432775:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 71 00000100:00100000:3.0:1787603909.432784:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2366:x1874438345732736:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603909.432877:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2366:x1874438345732736:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 94us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603909.432995:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345732480 00000100:00100000:0.0:1787603909.433000:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345732480 00000100:00100000:0.0:1787603909.433039:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 222 00000100:00100000:0.0:1787603909.433045:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2366:x1874438345732480:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603909.433071:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2366:x1874438345732480:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 26us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603909.433077:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 222 00000100:00100000:3.0:1787603909.433415:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 71 00000100:00100000:3.0:1787603909.433434:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 72 00000100:00100000:3.0:1787603909.433442:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2366:x1874438345732608:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603909.433484:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2366:x1874438345732608:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 43us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603909.433491:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 72 00000100:00100000:3.0:1787603909.433513:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345732992 00000100:00100000:3.0:1787603909.433517:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345732992 00000100:00100000:3.0:1787603909.433549:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345732864 00000100:00100000:3.0:1787603909.433565:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345732864 00000100:00100000:3.0:1787603909.433590:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 33 00000100:00100000:3.0:1787603909.433597:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2366:x1874438345732992:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603909.433628:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2366:x1874438345732992:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 32us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603909.433635:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 33 00000100:00100000:3.0:1787603909.433648:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 34 00000100:00100000:3.0:1787603909.433654:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2366:x1874438345732864:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603909.433678:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2366:x1874438345732864:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 24us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603909.433683:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 34 00000100:00080000:3.0:1787603909.433701:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787603909.433706:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787603909.433709:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787603910.039045:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603911.063020:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603911.639183:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355202176:0@lo:400:kworker.0 00000100:00100000:1.0:1787603911.639204:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355202432:0@lo:400:kworker.0 00000100:00100000:3.0:1787603911.639254:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355202048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787603911.639254:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355202304:0@lo:400:kworker.0 00000100:00100000:0.0:1787603911.639686:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603911.639748:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355202688:0@lo:400:kworker.0 00000100:00100000:0.0:1787603911.639775:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603911.639833:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355202176 00000100:00100000:0.0:1787603911.639858:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355202176 00000100:00100000:0.0:1787603911.639900:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787603911.639909:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355202176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603911.639958:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355202176:12345-0@lo:400:kworker.0 Request processed in 49us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603911.639964:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787603911.640011:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355202176:0@lo:400:kworker.0 00000100:00100000:0.0:1787603911.640047:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355202688 00000100:00100000:0.0:1787603911.640051:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355202688 00000100:00100000:0.0:1787603911.640099:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787603911.640106:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355202688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603911.640143:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355202688:12345-0@lo:400:kworker.0 Request processed in 38us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603911.640149:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787603911.640176:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355202688:0@lo:400:kworker.0 00000100:00100000:2.0:1787603911.640607:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603911.640629:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355202816:0@lo:400:kworker.0 00000100:00100000:2.0:1787603911.640650:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603911.640694:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355202304 00000100:00100000:2.0:1787603911.640699:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355202304 00000100:00100000:2.0:1787603911.640728:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787603911.640736:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355202304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603911.640769:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355202304:12345-0@lo:400:kworker.0 Request processed in 34us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603911.640775:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787603911.640805:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355202304:0@lo:400:kworker.0 00000100:00100000:2.0:1787603911.640857:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355202816 00000100:00100000:2.0:1787603911.640860:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355202816 00000100:00100000:2.0:1787603911.640887:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787603911.640900:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355202816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603911.640934:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355202816:12345-0@lo:400:kworker.0 Request processed in 35us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603911.640940:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787603911.640963:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf415500 x1874438355202816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603911.640973:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355202816:0@lo:400:kworker.0 00000100:00080000:0.0:1787603911.643028:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787603911.643043:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787603911.645170:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603911.645747:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603911.645782:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355202560:0@lo:400:kworker.0 00000100:00100000:3.0:1787603911.646007:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603911.646064:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355202560 00000100:00100000:1.0:1787603911.646081:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355202560 00000100:00100000:1.0:1787603911.646151:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787603911.646161:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355202560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603911.646231:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355202560:12345-0@lo:400:kworker.0 Request processed in 71us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603911.646249:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787603911.646493:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355202048 00000100:00100000:0.0:1787603911.646498:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355202048 00000100:00100000:0.0:1787603911.646538:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787603911.646546:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355202048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787603911.646577:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787603911.646676:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787603911.646707:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf415f80 x1874438355202560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603911.646721:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355202560:0@lo:400:kworker.0 00000100:00100000:2.0:1787603911.646723:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355202432 00000100:00100000:2.0:1787603911.646727:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355202432 00000100:00080000:3.0:1787603911.646744:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603911.646761:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787603911.646769:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355202432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603911.646796:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355202048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 251us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603911.646803:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787603911.646805:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355202432:12345-0@lo:400:kworker.0 Request processed in 39us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603911.646883:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787603911.647179:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355202432:0@lo:400:kworker.0 00010000:00080000:3.0:1787603911.647442:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed286af3100 x1874438355202048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603911.647467:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355202048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787603912.088011:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603912.151255:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787603912.151287:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355202944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787603912.151423:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603912.151578:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355202944 00000100:00100000:0.0:1787603912.151586:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355202944 00000100:00100000:0.0:1787603912.151634:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787603912.151644:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355202944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787603912.151679:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603912.151730:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355202944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603912.151738:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787603912.151871:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b6138e00 x1874438355202944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603912.151890:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355202944:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787603913.113202:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603914.135964:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603914.546635:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603914.546684:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603914.546720:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603914.546755:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603914.546781:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603914.546809:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345733376 00000100:00100000:3.0:1787603914.546820:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345733376 00000100:00100000:1.0:1787603914.546886:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345733632 00000100:00100000:1.0:1787603914.546892:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345733632 00000100:00100000:3.0:1787603914.546911:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345733248 00000100:00100000:3.0:1787603914.546916:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345733248 00000100:00100000:1.0:1787603914.546935:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345733504 00000100:00100000:1.0:1787603914.546941:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345733504 00000100:00100000:3.0:1787603914.546952:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 76 00000100:00100000:3.0:1787603914.546965:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2364:x1874438345733376:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603914.546969:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 37 00000100:00100000:1.0:1787603914.546982:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2364:x1874438345733632:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603914.547050:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2364:x1874438345733376:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 89us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603914.547060:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 76 00000100:00100000:2.0:1787603914.547081:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 77 00000100:00100000:2.0:1787603914.547092:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345733248:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603914.547150:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345733120 00000100:00100000:0.0:1787603914.547156:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345733120 00000100:00100000:0.0:1787603914.547199:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 224 00000100:00100000:0.0:1787603914.547206:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2364:x1874438345733120:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603914.547476:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787603914.547485:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1787603914.547500:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787603914.547509:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787603914.547512:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603914.549811:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2364:x1874438345733632:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 2820us (3076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603914.550114:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 37 00000100:00100000:1.0:1787603914.550154:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 38 00000100:00100000:1.0:1787603914.550168:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2364:x1874438345733504:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603914.550255:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2364:x1874438345733504:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 81us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603914.550261:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 38 00000100:00100000:0.0:1787603914.553919:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2364:x1874438345733120:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 6700us (7282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603914.553935:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 224 00000100:00100000:3.0:1787603914.555051:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345733248:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 7956us (8289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603914.555062:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 77 00010000:00010000:0.0:1787603915.159432:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603916.187083:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603916.761267:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787603916.761289:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355203072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603916.761359:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603916.761428:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355203072 00000100:00100000:3.0:1787603916.761437:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355203072 00000100:00100000:3.0:1787603916.761499:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787603916.761509:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355203072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787603916.761545:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603916.761604:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355203072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603916.761613:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787603916.761636:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787603916.761664:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf211f80 x1874438355203072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603916.761682:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355203072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787603916.769294:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355203200:0@lo:400:kworker.0 00000100:00100000:2.0:1787603916.769364:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603916.769402:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355203712:0@lo:400:kworker.0 00000100:00100000:2.0:1787603916.769429:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603916.769457:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787603916.769463:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355203584:0@lo:400:kworker.0 00000100:00100000:2.0:1787603916.769486:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603916.769511:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355203328:0@lo:400:kworker.0 00000100:00100000:2.0:1787603916.769547:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603916.769565:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787603916.769570:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355203456:0@lo:400:kworker.0 00000100:00100000:2.0:1787603916.769591:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603916.769638:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355203200 00000100:00100000:2.0:1787603916.769646:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355203200 00000100:00100000:2.0:1787603916.769695:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787603916.769704:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355203200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603916.769753:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355203200:12345-0@lo:400:kworker.0 Request processed in 51us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603916.769760:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787603916.769793:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355203712 00000100:00100000:2.0:1787603916.769797:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355203712 00000100:00100000:2.0:1787603916.769832:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787603916.769857:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355203712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603916.769890:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355203712:12345-0@lo:400:kworker.0 Request processed in 34us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603916.769897:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787603916.769914:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355203584 00000100:00100000:2.0:1787603916.769918:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355203584 00000100:00100000:2.0:1787603916.769942:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355203328 00000100:00100000:2.0:1787603916.769945:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355203328 00000100:00100000:2.0:1787603916.769954:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355203456 00000100:00100000:2.0:1787603916.769957:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355203456 00000100:00100000:2.0:1787603916.769970:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787603916.769977:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355203584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603916.770005:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355203584:12345-0@lo:400:kworker.0 Request processed in 29us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603916.770020:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787603916.770032:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787603916.770038:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355203328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603916.770074:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355203328:12345-0@lo:400:kworker.0 Request processed in 37us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603916.770080:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787603916.770091:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787603916.770097:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355203456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603916.770122:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355203456:12345-0@lo:400:kworker.0 Request processed in 26us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603916.770127:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787603916.770171:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355203584:0@lo:400:kworker.0 00000100:00100000:2.0:1787603916.770181:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355203200:0@lo:400:kworker.0 00010000:00080000:2.0:1787603916.770192:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed286af1180 x1874438355203712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603916.770201:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355203712:0@lo:400:kworker.0 00000100:00080000:2.0:1787603916.770234:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787603916.770240:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787603916.770262:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355203456:0@lo:400:kworker.0 00000100:00100000:2.0:1787603916.770271:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355203328:0@lo:400:kworker.0 00010000:00010000:3.0:1787603917.207340:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603917.271413:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355203840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787603917.271530:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603917.271987:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355203840 00000100:00100000:3.0:1787603917.272001:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355203840 00000100:00100000:3.0:1787603917.272072:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787603917.272084:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355203840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787603917.272133:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603917.272203:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355203840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603917.272232:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787603917.272290:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b613ad80 x1874438355203840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603917.272318:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355203840:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787603918.231180:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603919.261964:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603919.657372:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603919.657589:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345733760 00000100:00100000:0.0:1787603919.657600:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345733760 00000100:00100000:3.0:1787603919.657700:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603919.657740:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603919.657767:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603919.657792:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603919.657814:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345734144 00000100:00100000:3.0:1787603919.657818:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345734144 00000100:00100000:3.0:1787603919.657883:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345734272 00000100:00100000:3.0:1787603919.657887:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345734272 00000100:00100000:3.0:1787603919.657908:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00100000:3.0:1787603919.657918:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2362:x1874438345734144:12345-192.168.202.21@tcp:9:kworker.0 00000020:00000080:3.0:1787603919.657960:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19014e0 00000100:00080000:3.0:1787603919.657970:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9ed2ba363000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787603919.658006:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787603919.658376:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+2:2362:x1874438345734144:12345-192.168.202.21@tcp:9:kworker.0 Request processed in 458us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603919.658383:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00100000:3.0:1787603919.658412:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15 00000100:00100000:3.0:1787603919.658421:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2362:x1874438345734272:12345-192.168.202.21@tcp:9:kworker.0 00000020:00000080:3.0:1787603919.658435:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19014e7 00000100:00080000:3.0:1787603919.658442:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9ed1835ba000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787603919.658480:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787603919.658664:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+2:2362:x1874438345734272:12345-192.168.202.21@tcp:9:kworker.0 Request processed in 244us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603919.658671:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15 00010000:00010000:3.0:1787603919.658693:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787603919.658832:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787603919.658864:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603919.658875:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345734016 00000100:00100000:3.0:1787603919.658879:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345734016 00000100:00100000:3.0:1787603919.658908:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345733888 00000100:00100000:3.0:1787603919.658911:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345733888 00000100:00100000:3.0:1787603919.658928:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 81 00000100:00100000:3.0:1787603919.658934:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2363:x1874438345734016:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603919.658970:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2363:x1874438345734016:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 36us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603919.658978:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 81 00000100:00100000:3.0:1787603919.658990:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 82 00000100:00100000:3.0:1787603919.659013:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345733888:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603919.659038:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345733888:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 25us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603919.659043:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 82 00000100:00080000:3.0:1787603919.659057:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787603919.659076:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603919.662454:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 226 00000100:00100000:0.0:1787603919.662481:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2363:x1874438345733760:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603919.662571:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2363:x1874438345733760:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 103us (5209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603919.662578:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 226 00010000:00010000:1.0:1787603920.283499:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787603920.408596:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 649d83ee-97a0-4141-af13-8dc5b7a4524e 00000020:00000080:1.0:1787603920.408604:0:7632:0:(genops.c:885:class_export_put()) final put ffff9ed1835be800/649d83ee-97a0-4141-af13-8dc5b7a4524e 00000020:00000080:2.0:1787603920.408680:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed1835be800/649d83ee-97a0-4141-af13-8dc5b7a4524e for lustre-OST0001 00000020:00000080:2.0:1787603920.408775:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed1835ba000 for lustre-OST0001 00000001:00100000:2.0:1787603920.955942:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 649d83ee-97a0-4141-af13-8dc5b7a4524e 00000020:00000080:2.0:1787603920.955952:0:6705:0:(genops.c:885:class_export_put()) final put ffff9ed2ba364800/649d83ee-97a0-4141-af13-8dc5b7a4524e 00000020:00000080:2.0:1787603920.955980:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba364800/649d83ee-97a0-4141-af13-8dc5b7a4524e for lustre-OST0000 00000020:00000080:2.0:1787603920.956023:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2ba363000 for lustre-OST0000 00010000:00010000:3.0:1787603921.304294:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603921.880143:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355203968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787603921.880228:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603921.883015:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355203968 00000100:00100000:3.0:1787603921.883039:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355203968 00000100:00100000:3.0:1787603921.883209:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787603921.883222:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355203968:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787603921.883507:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787603921.883614:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603921.883709:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355203968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 489us (3480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603921.883718:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787603921.883815:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf212300 x1874438355203968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603921.883865:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355203968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603921.885758:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355204096:0@lo:400:kworker.0 00000100:00100000:3.0:1787603921.885822:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603921.885928:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355204096 00000100:00100000:0.0:1787603921.885936:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355204096 00000100:00100000:2.0:1787603921.885996:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355204224:0@lo:400:kworker.0 00000100:00100000:2.0:1787603921.886027:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603921.889039:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787603921.889058:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355204096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603921.889693:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355204352:0@lo:400:kworker.0 00000100:00100000:1.0:1787603921.889738:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603921.889771:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787603921.889777:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355204480:0@lo:400:kworker.0 00000100:00100000:1.0:1787603921.889799:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603921.889826:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355204224 00000100:00100000:1.0:1787603921.889833:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355204224 00000100:00100000:1.0:1787603921.889885:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355204352 00000100:00100000:1.0:1787603921.889889:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355204352 00000100:00100000:1.0:1787603921.889922:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355204480 00000100:00100000:1.0:1787603921.889925:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355204480 00000100:00100000:1.0:1787603921.889942:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787603921.889949:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355204224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603921.889986:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355204224:12345-0@lo:400:kworker.0 Request processed in 37us (3958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603921.889993:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787603921.890008:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787603921.890014:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355204352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603921.890067:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355204352:12345-0@lo:400:kworker.0 Request processed in 53us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603921.890087:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787603921.890099:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787603921.890106:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355204480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603921.890133:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355204480:12345-0@lo:400:kworker.0 Request processed in 28us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603921.890139:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787603921.890161:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603921.890203:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355204224:0@lo:400:kworker.0 00000100:00100000:1.0:1787603921.890222:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787603921.890228:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355204608:0@lo:400:kworker.0 00000100:00100000:1.0:1787603921.890259:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603921.891367:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355204480:0@lo:400:kworker.0 00000100:00100000:1.0:1787603921.891386:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355204352:0@lo:400:kworker.0 00000100:00100000:0.0:1787603921.891526:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355204096:12345-0@lo:400:kworker.0 Request processed in 2473us (5702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603921.891535:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355204608 00000100:00100000:0.0:1787603921.891540:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787603921.891542:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355204608 00000100:00100000:1.0:1787603921.891609:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787603921.891618:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355204608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603921.891671:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355204608:12345-0@lo:400:kworker.0 Request processed in 54us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603921.891677:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787603921.891859:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787603921.891880:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf414700 x1874438355204608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603921.891892:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355204608:0@lo:400:kworker.0 00000100:00100000:3.0:1787603921.895009:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355204096:0@lo:400:kworker.0 00010000:00010000:1.0:1787603922.333544:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603922.391398:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787603922.391424:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355204736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787603922.391510:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603922.392759:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355204736 00000100:00100000:0.0:1787603922.392770:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355204736 00000100:00100000:0.0:1787603922.392829:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787603922.392862:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355204736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787603922.392900:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603922.392964:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355204736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603922.392979:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787603922.393412:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b613aa00 x1874438355204736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603922.393431:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355204736:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787603922.409004:0:11002:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787603923.352525:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603924.379012:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603924.779597:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603924.779634:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603924.779656:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603924.779687:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345734528 00000100:00100000:3.0:1787603924.779696:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345734528 00000100:00100000:3.0:1787603924.779753:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345734656 00000100:00100000:3.0:1787603924.779756:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345734656 00000100:00100000:3.0:1787603924.779780:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 86 00000100:00100000:3.0:1787603924.779789:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2366:x1874438345734528:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603924.779901:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2366:x1874438345734528:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 112us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603924.779909:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 86 00000100:00100000:3.0:1787603924.779937:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 87 00000100:00100000:3.0:1787603924.779944:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345734656:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603924.779971:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345734656:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603924.779977:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 87 00000100:00080000:3.0:1787603924.780005:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787603924.780455:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345734400 00000100:00100000:0.0:1787603924.780461:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345734400 00000100:00100000:0.0:1787603924.780499:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 228 00000100:00100000:0.0:1787603924.780506:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345734400:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603924.780537:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345734400:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 33us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603924.780543:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 228 00010000:00010000:1.0:1787603925.399102:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787603926.130332:0:11150:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc25e9c240 20000000:00000080:0.0:1787603926.130354:0:11150:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ed2af09f000 uarg=0000000000000000 20000000:01000000:0.0:1787603926.130394:0:11150:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787603926.130401:0:11150:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787603926.130406:0:11150:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787603926.131228:0:11151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787603926.131386:0:11150:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787603926.136783:0:11150:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787603926.136815:0:11150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.137157:0:11150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a1901493 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5940 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.137170:0:11150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a19014a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190149a expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.137177:0:11150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19014af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19014a8 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.137195:0:11150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a19014bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19014b6 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.137204:0:11150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a19014d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5978 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.137212:0:11150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.137254:0:11150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a19014d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5978 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.137270:0:11150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a19014d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5978 expref: 12 pid: 5813 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603926.137284:0:11150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1874438355204864:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603926.137395:0:11150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a19014bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19014b6 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.137404:0:11150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a19014bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19014b6 expref: 18 pid: 5813 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603926.137413:0:11150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6139180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1874438355204992:0@lo:104: 00000100:00100000:0.0:1787603926.137454:0:11150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787603926.137490:0:11150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19014af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19014a8 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.137498:0:11150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19014af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19014a8 expref: 18 pid: 5815 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603926.137514:0:11150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6138000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1874438355205120:0@lo:104: 00000100:00100000:0.0:1787603926.137537:0:11150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787603926.137560:0:11150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a19014a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190149a expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.137567:0:11150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a19014a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190149a expref: 18 pid: 5815 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603926.137576:0:11150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1874438355205248:0@lo:104: 00000100:00100000:0.0:1787603926.137595:0:11150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787603926.137611:0:11150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a1901493 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5940 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.137619:0:11150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a1901493 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5940 expref: 12 pid: 5813 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603926.137627:0:11150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6139f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1874438355205376:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603926.137648:0:11150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc08d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787603926.137823:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355204992 00000100:00100000:3.0:1787603926.137829:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355204992 00000100:00100000:3.0:1787603926.137897:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355205120 00000100:00100000:3.0:1787603926.137901:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355205120 00000100:00100000:3.0:1787603926.137911:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355205248 00000100:00100000:3.0:1787603926.137914:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355205248 00000100:00100000:3.0:1787603926.137924:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787603926.137931:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+5:11150:x1874438355204992:12345-0@lo:104: 00010000:00010000:3.0:1787603926.137943:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19014bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140445:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787603926.140461:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+5:11150:x1874438355204992:12345-0@lo:104: Request processed in 2525us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603926.140471:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787603926.140504:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787603926.140515:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+4:11150:x1874438355205120:12345-0@lo:104: 00010000:00010000:3.0:1787603926.140531:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19014af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140595:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787603926.140613:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+4:11150:x1874438355205120:12345-0@lo:104: Request processed in 101us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603926.140618:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787603926.140631:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787603926.140638:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+3:11150:x1874438355205248:12345-0@lo:104: 00010000:00010000:3.0:1787603926.140645:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19014a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140677:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787603926.140682:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+3:11150:x1874438355205248:12345-0@lo:104: Request processed in 45us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603926.140688:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787603926.140705:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787603926.140711:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19014bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140718:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e800 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603926.140722:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19014bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140731:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19014bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603926.140738:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19014bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603926.140744:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787603926.140778:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19014bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140793:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603926.140816:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19014bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140823:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19014b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19014bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140858:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787603926.140861:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19014af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140867:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217c600 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603926.140869:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19014af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140875:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19014af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603926.140881:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19014af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603926.140885:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787603926.140897:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19014af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140902:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603926.140907:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19014af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140912:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2c217c600/0xb5d1f3b1a19014a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19014af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140926:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603926.140929:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19014a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140933:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217d400 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603926.140936:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19014a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140942:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19014a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603926.140947:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19014a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603926.140951:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787603926.140960:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19014a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.140965:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603926.140978:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19014a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.141056:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2c217d400/0xb5d1f3b1a190149a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19014a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.141071:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603926.141072:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603926.141074:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603926.141081:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603926.141091:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603926.141112:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355205504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787603926.141164:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603926.141202:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787603926.141208:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355205632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787603926.141230:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603926.141258:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355205760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787603926.141279:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603926.141311:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355205504 00000100:00100000:3.0:1787603926.141317:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355205504 00010000:00010000:3.0:1787603926.141341:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a19014bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19014b6 expref: 19 pid: 5813 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603926.141361:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355205632 00000100:00100000:3.0:1787603926.141365:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355205632 00010000:00010000:3.0:1787603926.141374:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19014af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19014a8 expref: 20 pid: 5815 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603926.141384:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355205760 00000100:00100000:3.0:1787603926.141386:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355205760 00010000:00010000:3.0:1787603926.141395:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a19014a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190149a expref: 21 pid: 5815 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603926.141407:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787603926.141414:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa48d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+21:3281:x1874438355205504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787603926.141424:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603926.141429:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a19014bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19014b6 expref: 21 pid: 5813 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.141449:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a19014bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19014b6 expref: 21 pid: 5813 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.141466:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603926.141495:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa48d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+21:3281:x1874438355205504:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603926.141501:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787603926.141542:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787603926.141549:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+20:3281:x1874438355205632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787603926.141556:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603926.141560:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19014af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19014a8 expref: 20 pid: 5815 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.141568:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19014af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19014a8 expref: 20 pid: 5815 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.141577:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603926.141596:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+20:3281:x1874438355205632:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603926.141601:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787603926.141613:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787603926.141619:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355205760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787603926.141626:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603926.141630:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a19014a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190149a expref: 19 pid: 5815 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.141638:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a19014a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190149a expref: 19 pid: 5815 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.141654:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603926.141680:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355205760:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603926.141687:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787603926.141728:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355205760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787603926.141752:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355205632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787603926.141758:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355205504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787603926.142331:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603926.142444:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1787603926.143316:0:11150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217de00/0xb5d1f3b1a19014bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19014b6 expref: 18 pid: 5813 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603926.143334:0:11150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6139180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1874438355204992:0@lo:104: 00010000:00010000:0.0:1787603926.143347:0:11150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217dc00/0xb5d1f3b1a19014af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19014a8 expref: 17 pid: 5815 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603926.143355:0:11150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6138000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1874438355205120:0@lo:104: 00010000:00010000:0.0:1787603926.143363:0:11150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217da00/0xb5d1f3b1a19014a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190149a expref: 16 pid: 5815 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603926.143384:0:11150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1874438355205248:0@lo:104: 00000100:00100000:0.0:1787603926.143398:0:11150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6139f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1874438355205376:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603926.143409:0:11150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1874438355204864:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603926.143436:0:11150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603926.143735:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345734784 00000100:00100000:1.0:1787603926.143743:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345734784 00010000:00010000:1.0:1787603926.143777:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a19014d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5978 expref: 13 pid: 5813 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603926.143809:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345734912 00000100:00100000:1.0:1787603926.143813:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345734912 00010000:00010000:1.0:1787603926.143830:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a1901493 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5940 expref: 14 pid: 5813 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603926.143892:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 28 00000100:00100000:1.0:1787603926.143902:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf211180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f844a97d-1878-4049-bbc8-d860aeb2443e+14:2364:x1874438345734784:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603926.143914:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603926.143919:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a19014d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5978 expref: 14 pid: 5813 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.143929:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a19014d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5978 expref: 14 pid: 5813 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.143944:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a19014d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5978 expref: 14 pid: 5813 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.143955:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603926.144123:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf211180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2364:x1874438345734784:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 222us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603926.144131:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 28 00000100:00100000:1.0:1787603926.144159:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 29 00000100:00100000:1.0:1787603926.144174:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f844a97d-1878-4049-bbc8-d860aeb2443e+12:2364:x1874438345734912:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603926.144182:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603926.144186:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a1901493 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5940 expref: 12 pid: 5813 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.144195:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a1901493 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5940 expref: 12 pid: 5813 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.144205:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a1901493 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5940 expref: 12 pid: 5813 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.144215:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.144222:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.144235:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.144242:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.144248:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.144254:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.144260:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594000 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787603926.144265:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.144280:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.144292:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603926.144301:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603926.144322:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f844a97d-1878-4049-bbc8-d860aeb2443e+11:2364:x1874438345734912:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 149us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603926.144329:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 29 00010000:00010000:0.0:1787603926.145012:0:11150:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.145025:0:11150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603926.145030:0:11150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a19014ee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603926.424048:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603926.999613:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787603927.001350:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355205888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603927.001426:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603927.001556:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355205888 00000100:00100000:3.0:1787603927.001566:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355205888 00000100:00100000:3.0:1787603927.001641:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787603927.001651:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355205888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787603927.001686:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603927.001736:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355205888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603927.001744:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787603927.003027:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787603927.003074:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf213480 x1874438355205888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603927.003107:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355205888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603927.004275:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355206016:0@lo:400:kworker.0 00000100:00100000:0.0:1787603927.004343:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603927.005900:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355206144:0@lo:400:kworker.0 00000100:00100000:3.0:1787603927.005964:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603927.006018:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355206144 00000100:00100000:3.0:1787603927.006025:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355206144 00000100:00100000:3.0:1787603927.006073:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787603927.006083:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355206144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603927.006202:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355206016 00000100:00100000:1.0:1787603927.006207:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355206016 00000100:00100000:1.0:1787603927.006238:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787603927.006246:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:3281:x1874438355206016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603927.009064:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:3281:x1874438355206016:12345-0@lo:400:kworker.0 Request processed in 2810us (4712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603927.009079:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787603927.009171:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355206016:0@lo:400:kworker.0 00000100:00100000:1.0:1787603927.009261:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355206144:0@lo:400:kworker.0 00000100:00100000:2.0:1787603927.009422:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355206400:0@lo:400:kworker.0 00000100:00100000:2.0:1787603927.009464:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603927.009491:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787603927.009497:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355206272:0@lo:400:kworker.0 00000100:00100000:2.0:1787603927.009518:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603927.009544:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355206400 00000100:00100000:2.0:1787603927.009550:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355206400 00000100:00100000:2.0:1787603927.009591:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355206272 00000100:00100000:2.0:1787603927.009594:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355206272 00000100:00100000:2.0:1787603927.009612:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787603927.009621:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355206400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603927.009680:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355206400:12345-0@lo:400:kworker.0 Request processed in 60us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603927.009686:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787603927.009702:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787603927.009708:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355206272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603927.009736:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355206272:12345-0@lo:400:kworker.0 Request processed in 29us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603927.009742:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1787603927.009762:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603927.009783:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355206272:0@lo:400:kworker.0 00000100:00100000:2.0:1787603927.009792:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355206400:0@lo:400:kworker.0 00000100:00100000:2.0:1787603927.009807:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787603927.009813:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355206528:0@lo:400:kworker.0 00000100:00100000:2.0:1787603927.009882:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603927.009908:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355206528 00000100:00100000:2.0:1787603927.009912:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355206528 00000100:00100000:2.0:1787603927.009945:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787603927.009952:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355206528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603927.009988:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355206528:12345-0@lo:400:kworker.0 Request processed in 37us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603927.009995:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787603927.010008:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787603927.010029:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b4d53100 x1874438355206528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603927.010039:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355206528:0@lo:400:kworker.0 00000100:00100000:3.0:1787603927.011106:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355206144:12345-0@lo:400:kworker.0 Request processed in 5018us (5135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603927.011118:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:3.0:1787603927.447220:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603927.511318:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355206656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787603927.511386:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603927.511496:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355206656 00000100:00100000:3.0:1787603927.511504:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355206656 00000100:00100000:3.0:1787603927.511558:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787603927.511568:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355206656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787603927.511603:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603927.511651:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355206656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603927.511659:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787603927.511699:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf213480 x1874438355206656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603927.511717:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355206656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787603927.660051:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603927.660675:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345735040 00000100:00100000:3.0:1787603927.660687:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345735040 00000100:00100000:3.0:1787603927.660748:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 230 00000100:00100000:3.0:1787603927.660758:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+11:5608:x1874438345735040:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787603927.660774:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603927.660797:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dad000/0xb5d1f3b1a19014f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59a2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.660822:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dad000/0xb5d1f3b1a19014f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a2 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.660833:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b5dad000/0xb5d1f3b1a19014f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a2 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.660881:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad000, rc 0) 00000100:00100000:3.0:1787603927.660949:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+12:5608:x1874438345735040:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 Request processed in 192us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603927.660956:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 230 00000100:00100000:3.0:1787603927.676808:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603927.676923:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345735168 00000100:00100000:1.0:1787603927.676933:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345735168 00000100:00100000:1.0:1787603927.676988:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 231 00000100:00100000:1.0:1787603927.676998:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+12:5608:x1874438345735168:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603927.677304:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+12:5608:x1874438345735168:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 Request processed in 306us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603927.677312:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 231 00000100:00100000:3.0:1787603927.680100:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603927.680248:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345735296 00000100:00100000:1.0:1787603927.680258:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345735296 00000100:00100000:1.0:1787603927.680314:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 232 00000100:00100000:1.0:1787603927.680325:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+12:5608:x1874438345735296:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787603927.680793:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+12:5608:x1874438345735296:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 Request processed in 468us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603927.680802:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 232 00000100:00100000:0.0:1787603927.695334:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603927.696287:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345735424 00000100:00100000:2.0:1787603927.696299:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345735424 00000100:00100000:2.0:1787603927.696347:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 233 00000100:00100000:2.0:1787603927.696357:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+12:5608:x1874438345735424:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787603927.696373:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603927.696390:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a19014fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59a9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603927.696417:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a19014fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a9 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603927.696427:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a19014fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a9 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603927.696437:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962c00, rc 0) 00000100:00100000:2.0:1787603927.696497:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:5608:x1874438345735424:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 Request processed in 142us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603927.696504:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 233 00000100:00100000:1.0:1787603927.702427:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603927.702603:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345735552 00000100:00100000:0.0:1787603927.702626:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345735552 00000100:00100000:0.0:1787603927.702689:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 234 00000100:00100000:0.0:1787603927.702699:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:5608:x1874438345735552:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787603927.703102:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:5608:x1874438345735552:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 Request processed in 402us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603927.703111:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 234 10000000:01000000:3.0:1787603927.704068:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787603927.704075:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed2b4d09000 from 7 10000000:01000000:3.0:1787603927.704080:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787603927.704121:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.704143:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.704154:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603927.704178:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355206784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787603927.707382:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603927.707432:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2984fd600 going to sleep for 11 seconds 00000100:00100000:3.0:1787603927.707461:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355206784 00000100:00100000:3.0:1787603927.707470:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355206784 00000100:00100000:3.0:1787603927.707514:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787603927.707524:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355206784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787603927.707539:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603927.707558:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dad600/0xb5d1f3b1a190150a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901503 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.707595:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dad600/0xb5d1f3b1a190150a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901503 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.707607:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b5dad600/0xb5d1f3b1a190150a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901503 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.707616:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad600, rc 0) 00000100:00100000:3.0:1787603927.707660:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355206784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603927.707667:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787603927.707723:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355206784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787603927.707740:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190150a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.707748:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190150a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603927.707810:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355206912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787603927.707858:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603927.707877:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2984fd600 going to sleep for 11 seconds 00000100:00100000:1.0:1787603927.708277:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603927.708300:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355206912 00000100:00100000:1.0:1787603927.708304:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355206912 00000100:00100000:1.0:1787603927.708330:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345735680 00000100:00100000:1.0:1787603927.708333:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345735680 00000100:00100000:1.0:1787603927.708346:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787603927.708353:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355206912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603927.708610:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355206912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603927.708617:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787603927.708640:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 237 00000100:00100000:1.0:1787603927.708647:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:5608:x1874438345735680:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787603927.708791:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:5608:x1874438345735680:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 Request processed in 143us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603927.708808:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 237 00000100:00100000:1.0:1787603927.708869:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355206912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603927.709254:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf414000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787603927.709296:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603927.709315:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa662780 going to sleep for 11 seconds 00000100:00100000:1.0:1787603927.709330:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355207040 00000100:00100000:1.0:1787603927.709333:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355207040 00000100:00100000:1.0:1787603927.709360:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787603927.709367:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355207040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787603927.709545:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355207040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603927.709552:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787603927.709590:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf414000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787603927.711056:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787603927.711149:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787603927.711167:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787603927.711178:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190150a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603927.711189:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190150a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603927.715405:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787603927.715416:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed286a76000 from 7 10000000:01000000:1.0:1787603927.715422:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787603927.715488:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603927.715514:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603927.715527:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603927.715552:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf414000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787603927.715624:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603927.715672:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa662780 going to sleep for 11 seconds 00000100:00100000:3.0:1787603927.716185:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355207168 00000100:00100000:3.0:1787603927.716192:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355207168 00000100:00100000:3.0:1787603927.716301:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787603927.716311:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355207168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787603927.716325:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603927.716337:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901518 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.716367:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901511 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.716377:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901511 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.716386:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dacc00, rc 0) 00000100:00100000:3.0:1787603927.716543:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355207168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603927.716551:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787603927.716749:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf414000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787603927.716765:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901518 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603927.716775:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901518 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603927.716833:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf414000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603927.717259:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603927.717286:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa662780 going to sleep for 11 seconds 00000100:00100000:0.0:1787603927.717344:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355207296 00000100:00100000:0.0:1787603927.717351:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355207296 00000100:00100000:0.0:1787603927.717390:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787603927.717409:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355207296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787603927.717643:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355207296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603927.717650:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787603927.718594:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf414000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603927.718636:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf414000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787603927.718687:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603927.718704:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa662780 going to sleep for 11 seconds 00000100:00100000:0.0:1787603927.718902:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355207424 00000100:00100000:0.0:1787603927.718907:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355207424 00000100:00100000:0.0:1787603927.718944:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787603927.718952:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355207424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787603927.719105:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355207424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603927.719113:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787603927.719270:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf414000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787603927.735905:0:11208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787603927.736203:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787603927.736228:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787603927.736239:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901518 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.736251:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901518 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603927.736261:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787603927.736264:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed29010d000 from 7 10000000:01000000:3.0:1787603927.736266:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787603927.736302:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.736310:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.736320:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603927.736360:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787603927.736423:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603927.736465:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed289e8a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787603927.736572:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355207552 00000100:00100000:2.0:1787603927.736579:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355207552 00000100:00100000:2.0:1787603927.736662:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787603927.736671:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355207552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787603927.736684:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603927.736696:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b4963200/0xb5d1f3b1a1901526 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190151f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603927.736716:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4963200/0xb5d1f3b1a1901526 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190151f expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603927.736733:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b4963200/0xb5d1f3b1a1901526 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190151f expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603927.736741:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963200, rc 0) 00000100:00100000:2.0:1787603927.736790:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355207552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603927.736796:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787603927.736883:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787603927.736896:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901526 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603927.736917:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901526 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603927.736961:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787603927.736986:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603927.745402:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed289e8a000 going to sleep for 11 seconds 00000100:00100000:0.0:1787603927.752517:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355207680 00000100:00100000:0.0:1787603927.752534:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355207680 00000100:00100000:0.0:1787603927.752588:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787603927.752598:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355207680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787603927.752915:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355207680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (15926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603927.752931:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787603927.752998:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf213480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787603927.753048:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6139f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787603927.753090:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603927.753118:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc083c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787603927.753141:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355207808 00000100:00100000:0.0:1787603927.753145:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355207808 00000100:00100000:0.0:1787603927.753161:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787603927.753167:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355207808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787603927.753296:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355207808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603927.753303:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787603927.753337:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6139f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355207808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787603927.759606:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787603927.764005:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787603927.764050:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787603927.764063:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901526 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603927.764075:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901526 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603928.471918:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603929.494992:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603929.906228:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603929.906274:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603929.906350:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345735936 00000100:00100000:3.0:1787603929.906359:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603929.906360:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345735936 00000100:00100000:0.0:1787603929.906491:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345735808 00000100:00100000:0.0:1787603929.906496:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345735808 00000100:00100000:0.0:1787603929.906530:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 245 00000100:00100000:0.0:1787603929.906540:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2363:x1874438345735808:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603929.906631:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2363:x1874438345735808:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 91us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603929.906639:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 245 00000100:00100000:2.0:1787603929.910558:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345736064 00000100:00100000:2.0:1787603929.910573:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345736064 00000100:00100000:2.0:1787603929.910645:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 91 00000100:00100000:2.0:1787603929.910657:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345735936:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603929.910742:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345735936:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (4521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603929.910749:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 91 00000100:00100000:2.0:1787603929.910766:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 92 00000100:00100000:2.0:1787603929.910773:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2363:x1874438345736064:12345-192.168.202.21@tcp:400:kworker.0 00000100:00080000:3.0:1787603929.910991:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603929.911098:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2363:x1874438345736064:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 324us (4736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603929.911247:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 92 00000001:02000400:2.0:1787603929.947244:0:11348:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787603930.520456:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603931.543298:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603932.121058:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355207936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787603932.121312:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603932.121391:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355207936 00000100:00100000:1.0:1787603932.121398:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355207936 00000100:00100000:1.0:1787603932.121453:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787603932.121463:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355207936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787603932.121496:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603932.121538:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355207936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603932.121545:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1787603932.121565:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603932.121967:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355208320:0@lo:400:kworker.0 00000100:00100000:3.0:1787603932.122002:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603932.122027:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787603932.122032:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355208192:0@lo:400:kworker.0 00000100:00100000:3.0:1787603932.122056:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603932.122082:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355208320 00000100:00100000:3.0:1787603932.122103:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355208320 00000100:00100000:3.0:1787603932.122147:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355208192 00000100:00100000:3.0:1787603932.122151:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355208192 00000100:00100000:3.0:1787603932.122171:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787603932.122178:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355208320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603932.122214:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355208320:12345-0@lo:400:kworker.0 Request processed in 37us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603932.122221:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787603932.122233:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787603932.122239:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355208192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603932.122264:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355208192:12345-0@lo:400:kworker.0 Request processed in 25us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603932.122269:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787603932.122301:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355208192:0@lo:400:kworker.0 00000100:00100000:3.0:1787603932.122311:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355208320:0@lo:400:kworker.0 00010000:00080000:1.0:1787603932.124060:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2bf414000 x1874438355207936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603932.124104:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355207936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787603932.124132:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355208448:0@lo:400:kworker.0 00000100:00100000:1.0:1787603932.124183:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603932.124222:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355208448 00000100:00100000:1.0:1787603932.124222:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787603932.124228:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355208064:0@lo:400:kworker.0 00000100:00100000:3.0:1787603932.124229:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355208448 00000100:00100000:1.0:1787603932.124257:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603932.124278:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787603932.124278:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355208576:0@lo:400:kworker.0 00000100:00100000:3.0:1787603932.124288:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355208448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603932.124301:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603932.124341:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355208576 00000100:00100000:3.0:1787603932.124343:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355208448:12345-0@lo:400:kworker.0 Request processed in 57us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603932.124344:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355208576 00000100:00100000:3.0:1787603932.124350:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787603932.124374:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787603932.124381:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355208576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603932.124414:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355208576:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603932.124426:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787603932.124449:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787603932.124454:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787603932.124782:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2ba1a8000 x1874438355208576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603932.124793:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355208576:0@lo:400:kworker.0 00000100:00100000:1.0:1787603932.124804:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355208448:0@lo:400:kworker.0 00000100:00100000:0.0:1787603932.125245:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355208064 00000100:00100000:0.0:1787603932.125250:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355208064 00000100:00100000:0.0:1787603932.125290:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787603932.125298:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355208064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603932.125357:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355208064:12345-0@lo:400:kworker.0 Request processed in 59us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603932.125364:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787603932.125720:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355208064:0@lo:400:kworker.0 00010000:00010000:3.0:1787603932.567247:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603932.638402:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355208704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787603932.638479:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603932.638978:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355208704 00000100:00100000:0.0:1787603932.638985:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355208704 00000100:00100000:0.0:1787603932.639031:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787603932.639040:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355208704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787603932.639074:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603932.639139:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355208704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603932.639146:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787603932.639183:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b6139f80 x1874438355208704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603932.639200:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355208704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787603933.591654:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787603934.087002:0:11448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:38:52 (1787603932) === 00000100:00100000:3.0:1787603934.502300:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603934.505176:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345736192 00000100:00100000:2.0:1787603934.505194:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345736192 00000100:00100000:2.0:1787603934.505302:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00100000:2.0:1787603934.505315:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2366:x1874438345736192:12345-192.168.202.21@tcp:41:mkdir.0 00000004:00000024:2.0:1787603934.505359:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787603934.505453:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2366:x1874438345736192:12345-192.168.202.21@tcp:41:mkdir.0 Request processed in 142us (3164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603934.505461:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00080000:1.0:1787603934.505638:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603934.506241:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603934.506321:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345736320 00000100:00100000:1.0:1787603934.506326:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345736320 00000100:00100000:1.0:1787603934.506366:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:1.0:1787603934.506374:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:9685:x1874438345736320:12345-192.168.202.21@tcp:700:mkdir.0 00000100:00100000:1.0:1787603934.506432:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:9685:x1874438345736320:12345-192.168.202.21@tcp:700:mkdir.0 Request processed in 57us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603934.506438:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:0.0:1787603934.512834:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603934.513117:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345736576 00000100:00100000:3.0:1787603934.513139:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345736576 00000100:00100000:3.0:1787603934.513202:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15 00000100:00100000:3.0:1787603934.513212:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:9685:x1874438345736576:12345-192.168.202.21@tcp:36:mkdir.0 00010000:00010000:3.0:1787603934.513267:0:7875:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603934.513343:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2813a0000/0xb5d1f3b1a190140e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e592b expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.513367:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603934.513377:0:7875:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787603934.513685:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190152d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.513699:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190152d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.513709:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190152d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.513738:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901534 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.513747:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901534 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.513754:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901534 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603934.516293:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787603934.516317:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190152d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.516327:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190152d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.516341:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190152d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.516347:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603934.516351:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190152d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.516359:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190152d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.516376:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35000) 00010000:00010000:3.0:1787603934.516380:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603934.516385:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190152d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.516391:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190152d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787603934.516409:0:7875:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad6d748f reply state 00000000f70a43be transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901534 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603934.516418:0:7875:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787603934.517129:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:9685:x1874438345736576:12345-192.168.202.21@tcp:36:mkdir.0 Request processed in 3911us (4296us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787603934.517141:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15 00010000:00010000:1.0:1787603934.530105:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901534 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603934.530124:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901534 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603934.530132:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901534 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603934.530139:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603934.530144:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901534 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603934.530169:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901534 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603934.530201:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ed290d35500) 00010000:00010000:1.0:1787603934.530205:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603934.530210:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901534 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603934.530217:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901534 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603934.545696:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603934.545811:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345736704 00000100:00100000:2.0:1787603934.545821:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345736704 00000100:00100000:2.0:1787603934.545934:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:2.0:1787603934.545946:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:9688:x1874438345736704:12345-192.168.202.21@tcp:101:chmod.0 00010000:00010000:2.0:1787603934.545966:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603934.545991:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a190153b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59b0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.546051:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1901542 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.546075:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1901542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.546092:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1901542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787603934.546151:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787603934.546161:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787603934.546205:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1901542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.546230:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a190153b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59b0 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.546245:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1901542 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59b0 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.546254:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed2b2e8bd00) 00010000:00010000:2.0:1787603934.546256:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787603934.546260:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963000, rc 0) 00000100:00100000:2.0:1787603934.546382:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:9688:x1874438345736704:12345-192.168.202.21@tcp:101:chmod.0 Request processed in 436us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603934.546389:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:3.0:1787603934.563419:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603934.563594:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345736960 00000100:00100000:0.0:1787603934.563606:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345736960 00000100:00100000:0.0:1787603934.563669:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:0.0:1787603934.563681:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:9688:x1874438345736960:12345-192.168.202.21@tcp:36:chmod.0 00010000:00010000:0.0:1787603934.563739:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603934.563769:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1901542 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59b0 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.563791:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed2b2e8bd00) 00010000:00010000:0.0:1787603934.563803:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787603934.563831:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901549 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.563911:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901549 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.563920:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901549 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787603934.564242:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b708ee2 reply state 0000000068a00f01 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901549 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603934.564253:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787603934.564267:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787603934.564363:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:9688:x1874438345736960:12345-192.168.202.21@tcp:36:chmod.0 Request processed in 683us (952us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787603934.564371:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17 00010000:00010000:3.0:1787603934.572156:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901549 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.572175:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901549 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.572206:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901549 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.572212:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595c00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603934.572217:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901549 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.572226:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901549 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.572241:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b200) 00010000:00010000:3.0:1787603934.572245:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787603934.572250:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901549 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.572256:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901549 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603934.608419:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603934.609272:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345737088 00000100:00100000:2.0:1787603934.609288:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345737088 00000100:00100000:2.0:1787603934.609356:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 18 00000100:00100000:2.0:1787603934.609367:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:9690:x1874438345737088:12345-192.168.202.21@tcp:101:chown.0 00010000:00010000:2.0:1787603934.609392:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603934.609417:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59b7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.609485:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901557 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.609499:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901557 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.609527:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901557 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787603934.609583:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787603934.609588:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787603934.609629:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901557 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.609983:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59b7 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.610003:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901557 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59b7 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.610012:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed2b2e8b000) 00010000:00010000:2.0:1787603934.610015:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787603934.610018:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962400, rc 0) 00000100:00100000:2.0:1787603934.610089:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:9690:x1874438345737088:12345-192.168.202.21@tcp:101:chown.0 Request processed in 724us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603934.610096:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 18 00010000:00010000:3.0:1787603934.615323:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603934.620256:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603934.620502:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345737216 00000100:00100000:0.0:1787603934.620514:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345737216 00000100:00100000:0.0:1787603934.620590:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:0.0:1787603934.620612:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:9690:x1874438345737216:12345-192.168.202.21@tcp:101:chown.0 00010000:00010000:0.0:1787603934.620631:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603934.620662:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190155e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59be expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.620732:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901565 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.620746:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.620756:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.620770:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a190156c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.620777:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a190156c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.620784:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a190156c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621054:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621062:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621081:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603934.621149:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787603934.621152:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787603934.621177:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621188:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621195:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901565 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621201:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901565 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621207:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603934.621212:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901565 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621219:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901565 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621231:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed2b2e8b000) 00010000:00010000:0.0:1787603934.621234:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603934.621238:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901565 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621244:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901565 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621256:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a190156c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621273:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a190156c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621278:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a190156c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621283:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603934.621286:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a190156c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621292:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a190156c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621299:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ed28870bd00) 00010000:00010000:0.0:1787603934.621301:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603934.621304:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a190156c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621310:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a190156c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621340:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190155e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59be expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621355:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59be expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.621362:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ed28870b100) 00010000:00010000:0.0:1787603934.621364:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787603934.621372:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594200, rc 0) 00000100:00100000:0.0:1787603934.621438:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:9690:x1874438345737216:12345-192.168.202.21@tcp:101:chown.0 Request processed in 827us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603934.621446:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:1.0:1787603934.624408:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603934.624490:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345737472 00000100:00100000:3.0:1787603934.624503:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345737472 00000100:00100000:3.0:1787603934.624562:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00100000:3.0:1787603934.624571:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:9690:x1874438345737472:12345-192.168.202.21@tcp:36:chown.0 00010000:00010000:3.0:1787603934.624622:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603934.624659:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59be expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.624679:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ed28870b100) 00010000:00010000:3.0:1787603934.624701:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787603934.624724:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190157a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.624735:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190157a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.624745:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190157a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787603934.670259:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1787603934.670276:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787603934.670363:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031259d10 reply state 000000008b7a84bd transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190157a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603934.670378:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787603934.670533:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787603934.670633:0:5821:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787603934.670651:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:9690:x1874438345737472:12345-192.168.202.21@tcp:36:chown.0 Request processed in 46076us (46247us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787603934.670660:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 20 00010000:00010000:2.0:1787603934.670704:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190157a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.670713:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190157a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.670720:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190157a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.670725:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603934.670730:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190157a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.670737:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190157a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.670752:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ed290d35000) 00010000:00010000:2.0:1787603934.670755:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787603934.670760:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190157a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.670766:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190157a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603934.688728:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603934.688823:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345737600 00000100:00100000:0.0:1787603934.688859:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345737600 00000100:00100000:0.0:1787603934.688927:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 21 00000100:00100000:0.0:1787603934.688940:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:9691:x1874438345737600:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1787603934.688965:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603934.688986:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901581 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59c5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787603934.691053:0:5822:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2015us 00010000:00010000:3.0:1787603934.707729:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901588 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.707753:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901588 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.707765:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901588 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.707783:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a190158f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.708156:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a190158f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.708167:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a190158f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.708620:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901596 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.708631:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.708648:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603934.708729:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787603934.708732:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787603934.709124:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709138:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901588 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709145:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901588 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709152:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901588 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709158:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603934.709162:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901588 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709168:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901588 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709180:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed2b2e8b000) 00010000:00010000:3.0:1787603934.709183:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603934.709186:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709192:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709211:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a190158f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709216:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a190158f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709221:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a190158f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709225:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603934.709228:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a190158f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709233:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a190158f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709239:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ed290d35800) 00010000:00010000:3.0:1787603934.709242:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603934.709244:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a190158f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709249:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a190158f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709283:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901581 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59c5 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709297:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59c5 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.709314:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ed290d35a00) 00010000:00010000:3.0:1787603934.709317:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787603934.709319:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac000, rc 0) 00000100:00100000:3.0:1787603934.709430:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:9691:x1874438345737600:12345-192.168.202.21@tcp:101:touch.500 Request processed in 20492us (20712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603934.709437:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 21 00000100:00100000:1.0:1787603934.712819:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603934.713002:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345737856 00000100:00100000:0.0:1787603934.713012:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345737856 00000100:00100000:0.0:1787603934.713078:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 22 00000100:00100000:0.0:1787603934.713088:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:9691:x1874438345737856:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1787603934.713106:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603934.713125:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a190159d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59cc expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.713403:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19015a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.713418:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19015a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.713429:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19015a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.713485:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a19015ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.713493:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a19015ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.713499:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a19015ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787603934.715057:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787603934.715353:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19015b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.715368:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19015b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.715379:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19015b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.715411:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19015a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.715418:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19015a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.715424:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19015a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.715430:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603934.715434:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19015a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.715451:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19015a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.715463:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ed290d35a00) 00010000:00010000:0.0:1787603934.715465:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603934.715469:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19015a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.715475:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19015a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787603934.715485:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028aa7671 reply state 000000006df2ceae transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a19015ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603934.715493:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787603934.715526:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a190159d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59cc expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.715539:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19015b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59cc expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.715546:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ed28870ba00) 00010000:00010000:0.0:1787603934.715548:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787603934.715551:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594800, rc 0) 00000100:00100000:0.0:1787603934.715626:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:9691:x1874438345737856:12345-192.168.202.21@tcp:101:touch.500 Request processed in 2539us (2815us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787603934.715634:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 22 00010000:00010000:2.0:1787603934.717966:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a19015ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.717984:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a19015ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.717992:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a19015ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.718018:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603934.718022:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a19015ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.718030:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a19015ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.718045:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x928f5058 (ffff9ed28870bd00) 00010000:00010000:2.0:1787603934.718048:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603934.718052:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a19015ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.718057:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a19015ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603934.721498:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603934.721571:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345738112 00000100:00100000:3.0:1787603934.721581:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345738112 00000100:00100000:3.0:1787603934.721639:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 23 00000100:00100000:3.0:1787603934.721649:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:9691:x1874438345738112:12345-192.168.202.21@tcp:36:touch.500 00010000:00010000:3.0:1787603934.721706:0:7875:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603934.722050:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19015b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59cc expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.722081:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ed28870ba00) 00010000:00010000:3.0:1787603934.722213:0:7875:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787603934.722260:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.722274:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.722284:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787603934.722415:0:7875:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b6b80ce reply state 000000004a6a6f82 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603934.722442:0:7875:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787603934.722576:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:9691:x1874438345738112:12345-192.168.202.21@tcp:36:touch.500 Request processed in 927us (1085us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787603934.722583:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 23 00000100:00100000:2.0:1787603934.726352:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603934.726501:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345738240 00000100:00100000:0.0:1787603934.726523:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345738240 00000100:00100000:0.0:1787603934.726578:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 24 00000100:00100000:0.0:1787603934.726588:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:9691:x1874438345738240:12345-192.168.202.21@tcp:101:touch.500 00010000:00010000:0.0:1787603934.726612:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603934.726632:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19015c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59d3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.726690:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19015c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59d3 expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.726705:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19015c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59d3 expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.726726:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ed290d35800) 00010000:00010000:0.0:1787603934.726729:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787603934.726733:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595800, rc 0) 00000100:00100000:0.0:1787603934.726793:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:9691:x1874438345738240:12345-192.168.202.21@tcp:101:touch.500 Request processed in 206us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603934.726800:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 24 00010000:00010000:3.0:1787603934.727031:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.727040:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.727047:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.727053:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603934.727057:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.727078:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.727098:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ed290d35800) 00010000:00010000:3.0:1787603934.727101:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603934.727105:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.727112:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603934.730334:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603934.730406:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345738368 00000100:00100000:3.0:1787603934.730417:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345738368 00000100:00100000:3.0:1787603934.730473:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:3.0:1787603934.730481:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1874438345738368:12345-192.168.202.21@tcp:8:touch.500 00010000:00080000:3.0:1787603934.730513:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1787603934.730543:0:6676:0:(genops.c:1385:class_connect()) connect: client a45d6158-dc8e-48e6-b534-483bf3fa20ad, cookie 0xb5d1f3b1a19015ce 00002000:00100000:3.0:1787603934.730555:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a45d6158-dc8e-48e6-b534-483bf3fa20ad/ffff9ed2b6f7f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787603934.730576:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:3.0:1787603934.730810:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787603934.730875:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9ed2b6f7d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787603934.731123:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2362:x1874438345738368:12345-192.168.202.21@tcp:8:touch.500 Request processed in 640us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603934.731131:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:1.0:1787603934.733917:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603934.734287:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345738496 00000100:00100000:2.0:1787603934.734296:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345738496 00000100:00100000:2.0:1787603934.734406:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:2.0:1787603934.734417:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:0:x1874438345738496:12345-192.168.202.21@tcp:2:touch.500 00000100:00080000:1.0:1787603934.736288:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787603934.761673:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1787603934.761693:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000100:00100000:3.0:1787603934.762078:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:0:x1874438345738496:12345-192.168.202.21@tcp:2:touch.500 Request processed in 27647us (28161us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787603934.762091:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:2.0:1787603934.764523:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603934.764893:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345738752 00000100:00100000:3.0:1787603934.765059:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345738752 00000100:00100000:3.0:1787603934.765128:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 2 00000100:00100000:3.0:1787603934.765137:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:9691:x1874438345738752:12345-192.168.202.21@tcp:35:touch.500 00000100:00100000:3.0:1787603934.765557:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:9691:x1874438345738752:12345-192.168.202.21@tcp:35:touch.500 Request processed in 419us (1041us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787603934.765565:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 2 00000100:00100000:2.0:1787603934.776565:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603934.776667:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345738880 00000100:00100000:0.0:1787603934.776677:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345738880 00000100:00100000:0.0:1787603934.776734:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 25 00000100:00100000:0.0:1787603934.776746:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:9692:x1874438345738880:12345-192.168.202.21@tcp:101:rm.0 00010000:00010000:0.0:1787603934.776770:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603934.776790:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19015d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.777136:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19015dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.777149:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19015dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.777160:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19015dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603934.777211:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787603934.777215:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787603934.777253:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19015dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.777277:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19015d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59da expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.777293:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19015dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59da expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.777302:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ed290d35a00) 00010000:00010000:0.0:1787603934.777305:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787603934.777308:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594800, rc 0) 00000100:00100000:0.0:1787603934.777406:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+12:9692:x1874438345738880:12345-192.168.202.21@tcp:101:rm.0 Request processed in 662us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603934.777413:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 25 00000100:00100000:0.0:1787603934.784360:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603934.784446:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345739136 00000100:00100000:3.0:1787603934.784463:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345739136 00000100:00100000:3.0:1787603934.784581:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 26 00000100:00100000:3.0:1787603934.784593:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+12:9692:x1874438345739136:12345-192.168.202.21@tcp:101:rm.0 00010000:00010000:3.0:1787603934.784634:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603934.784674:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59e1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603934.784801:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787603934.784999:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59e1 expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.785015:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed2b2e8b000) 00010000:00010000:3.0:1787603934.785019:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787603934.785024:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59e1 expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.785036:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad800, rc 0) 00000100:00100000:3.0:1787603934.785124:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:9692:x1874438345739136:12345-192.168.202.21@tcp:101:rm.0 Request processed in 534us (774us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1787603934.785132:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 26 00000100:00100000:2.0:1787603934.790981:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603934.791061:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345739264 00000100:00100000:1.0:1787603934.791080:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345739264 00000100:00100000:1.0:1787603934.791130:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3 00000100:00100000:1.0:1787603934.791141:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:9692:x1874438345739264:12345-192.168.202.21@tcp:37:rm.0 00000100:00100000:2.0:1787603934.794301:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:9692:x1874438345739264:12345-192.168.202.21@tcp:37:rm.0 Request processed in 3154us (3318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603934.794313:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3 00000100:00100000:0.0:1787603934.802117:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603934.802326:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345739520 00000100:00100000:3.0:1787603934.802338:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345739520 00000100:00100000:3.0:1787603934.802395:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:3.0:1787603934.802406:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed291f95450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:9692:x1874438345739520:12345-192.168.202.21@tcp:35:rm.0 00000100:00100000:3.0:1787603934.802693:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed291f95450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:9692:x1874438345739520:12345-192.168.202.21@tcp:35:rm.0 Request processed in 287us (586us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787603934.802700:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:1.0:1787603934.817996:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603934.818127:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345739776 00000100:00100000:3.0:1787603934.818138:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345739776 00000100:00100000:3.0:1787603934.818207:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 27 00000100:00100000:3.0:1787603934.818236:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:9692:x1874438345739776:12345-192.168.202.21@tcp:101:rm.0 00010000:00010000:3.0:1787603934.818261:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603934.818282:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59e8 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.818406:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19015f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.818422:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19015f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.818433:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19015f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603934.818445:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787603934.818605:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19015f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59e8 expref: 17 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.818625:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19015f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59e8 expref: 16 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.818634:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ed290d35a00) 00010000:00010000:3.0:1787603934.818655:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787603934.818659:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac200, rc 0) 00000100:00100000:3.0:1787603934.818711:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:9692:x1874438345739776:12345-192.168.202.21@tcp:101:rm.0 Request processed in 478us (724us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787603934.818718:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 27 00000100:00100000:1.0:1787603934.825100:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603934.825199:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345739904 00000100:00100000:2.0:1787603934.825219:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345739904 00000100:00100000:2.0:1787603934.825272:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 28 00000100:00100000:2.0:1787603934.825282:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:9692:x1874438345739904:12345-192.168.202.21@tcp:41:rm.0 00000004:00000024:2.0:1787603934.825340:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787603934.825403:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:9692:x1874438345739904:12345-192.168.202.21@tcp:41:rm.0 Request processed in 123us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603934.825408:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 28 00000100:00100000:0.0:1787603934.828395:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603934.828464:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345740032 00000100:00100000:3.0:1787603934.828475:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345740032 00000100:00100000:3.0:1787603934.828572:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 29 00000100:00100000:3.0:1787603934.828580:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:9692:x1874438345740032:12345-192.168.202.21@tcp:101:rm.0 00010000:00010000:3.0:1787603934.828602:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603934.828621:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a1901606 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59ef expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828692:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190160d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828707:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190160d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828718:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190160d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828733:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901614 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828740:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828748:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828881:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5daca00/0xb5d1f3b1a190161b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828890:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5daca00/0xb5d1f3b1a190161b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828897:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5daca00/0xb5d1f3b1a190161b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603934.828930:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787603934.828933:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787603934.828946:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5daca00/0xb5d1f3b1a190161b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828955:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5daca00/0xb5d1f3b1a190161b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828961:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190160d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828965:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190160d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828969:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190160d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828972:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603934.828975:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190160d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828980:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190160d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828988:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ed290d35a00) 00010000:00010000:3.0:1787603934.828990:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603934.828993:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190160d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.828997:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190160d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.829012:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.829015:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901614 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.829019:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.829021:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603934.829023:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.829026:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901614 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.829030:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x928f5058 (ffff9ed290d35b00) 00010000:00010000:3.0:1787603934.829031:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603934.829033:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901614 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.829037:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901614 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.829074:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a1901606 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59ef expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.829088:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5daca00/0xb5d1f3b1a190161b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59ef expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.829106:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ed290d35800) 00010000:00010000:3.0:1787603934.829107:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787603934.829110:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5daca00, rc 0) 00000100:00100000:3.0:1787603934.829162:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:9692:x1874438345740032:12345-192.168.202.21@tcp:101:rm.0 Request processed in 581us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603934.829169:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 29 00000100:00100000:1.0:1787603934.837142:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603934.837231:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345740288 00000100:00100000:3.0:1787603934.837242:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345740288 00000100:00100000:3.0:1787603934.837304:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00100000:3.0:1787603934.837316:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:9692:x1874438345740288:12345-192.168.202.21@tcp:36:rm.0 00010000:00010000:3.0:1787603934.837372:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787603934.837398:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5daca00/0xb5d1f3b1a190161b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59ef expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.837417:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19015c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59d3 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.837427:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ed290d35800) 00010000:00010000:3.0:1787603934.837452:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19015dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59da expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.837461:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ed290d35a00) 00010000:00010000:3.0:1787603934.837464:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787603934.837482:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a1901622 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.837511:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a1901622 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.837521:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a1901622 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.837535:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901629 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.837541:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.837547:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.837669:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901630 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.837677:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901630 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.837685:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901630 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787603934.840050:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787603934.840082:0:5821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 267904243537ns, next at 268904239372ns, rc = 0 00010000:00010000:2.0:1787603934.840175:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901637 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840192:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840203:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840212:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901637 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840219:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901637 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840225:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840330:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787603934.840359:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901630 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840385:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901630 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840390:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901630 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840396:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603934.840402:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901630 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840409:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901630 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840423:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ed290d35600) 00010000:00010000:2.0:1787603934.840426:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787603934.840431:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901630 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840437:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901630 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840455:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a1901622 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840461:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a1901622 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840468:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a1901622 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840474:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603934.840484:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a1901622 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840490:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a1901622 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840499:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ed290d35a00) 00010000:00010000:2.0:1787603934.840501:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603934.840504:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a1901622 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.840510:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a1901622 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787603934.840522:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068cf4491 reply state 000000006feb8ed4 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603934.840531:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787603934.840700:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:9692:x1874438345740288:12345-192.168.202.21@tcp:36:rm.0 Request processed in 3381us (3563us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787603934.840710:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 30 00010000:00010000:3.0:1787603934.841098:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603934.841105:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901637 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.841111:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962e00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787603934.841114:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901637 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.841131:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.841140:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ed290d35600) 00010000:00010000:3.0:1787603934.841142:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787603934.841145:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901637 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.841150:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901637 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603934.841164:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603934.841166:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603934.841167:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603934.844789:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.844802:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901629 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.844807:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901629 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.844811:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603934.844814:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901629 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.844830:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901629 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.844875:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x928f5058 (ffff9ed290d35b00) 00010000:00010000:2.0:1787603934.844879:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603934.844884:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901629 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603934.844891:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901629 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x928f5058 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603934.850211:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603934.854582:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345740544 00000100:00100000:3.0:1787603934.854597:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345740544 00000100:00100000:0.0:1787603934.859458:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:0.0:1787603934.859479:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:9692:x1874438345740544:12345-192.168.202.21@tcp:35:rm.0 00000100:00100000:0.0:1787603934.859806:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:9692:x1874438345740544:12345-192.168.202.21@tcp:35:rm.0 Request processed in 330us (9606us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787603934.859815:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:1.0:1787603934.864164:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603934.864251:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345740800 00000100:00100000:0.0:1787603934.864260:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345740800 00000100:00100000:0.0:1787603934.864364:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 31 00000100:00100000:0.0:1787603934.864375:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:9692:x1874438345740800:12345-192.168.202.21@tcp:36:rm.0 00010000:00010000:0.0:1787603934.864443:0:7875:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787603934.864469:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19015f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59e8 expref: 16 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.864490:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901596 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59c5 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.864502:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ed290d35a00) 00010000:00010000:0.0:1787603934.864517:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901557 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59b7 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.864525:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed2b2e8b000) 00010000:00010000:0.0:1787603934.864532:0:7875:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787603934.864558:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a190163e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.864572:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a190163e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.864595:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a190163e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.864609:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901645 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.864617:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901645 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.864624:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901645 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.865357:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190164c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.865368:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190164c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.865376:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190164c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603934.866449:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787603934.866469:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190164c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866477:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190164c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866483:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190164c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866489:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603934.866500:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190164c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866507:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190164c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866519:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ed28870b400) 00010000:00010000:0.0:1787603934.866522:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787603934.866525:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190164c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866531:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190164c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866551:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a190163e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866556:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a190163e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866561:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a190163e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866565:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603934.866567:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a190163e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866572:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a190163e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866578:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870bc00) 00010000:00010000:0.0:1787603934.866581:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603934.866589:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a190163e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.866594:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a190163e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787603934.866606:0:7875:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8a8cc99 reply state 00000000f49ace63 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901645 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603934.866614:0:7875:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787603934.869013:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:9692:x1874438345740800:12345-192.168.202.21@tcp:36:rm.0 Request processed in 4626us (4913us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787603934.869025:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 31 00010000:00010000:0.0:1787603934.874653:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901645 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.874672:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901645 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.874680:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901645 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.874687:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595c00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603934.874691:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901645 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.874697:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901645 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.874712:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ed28870b000) 00010000:00010000:0.0:1787603934.874715:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603934.874718:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901645 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603934.874746:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901645 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603935.018158:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603935.018251:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603935.018338:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345741056 00000100:00100000:2.0:1787603935.018348:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345741056 00000100:00100000:2.0:1787603935.018424:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 96 00000100:00100000:2.0:1787603935.018436:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345741056:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603935.018511:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345741056:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 77us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603935.018519:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 96 00000100:00080000:0.0:1787603935.018682:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603935.019415:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345740928 00000100:00100000:3.0:1787603935.019422:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345740928 00000100:00100000:3.0:1787603935.019508:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 247 00000100:00100000:3.0:1787603935.019518:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345740928:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603935.019573:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345740928:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 56us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603935.019580:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 247 00010000:00010000:0.0:1787603935.661339:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603936.664952:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603937.239856:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787603937.239881:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355208832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603937.239994:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603937.241722:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355208960:0@lo:400:kworker.0 00000100:00100000:0.0:1787603937.241786:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603937.241827:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355209472:0@lo:400:kworker.0 00000100:00100000:0.0:1787603937.241900:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603937.241928:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787603937.241935:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355209088:0@lo:400:kworker.0 00000100:00100000:0.0:1787603937.241980:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603937.242032:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355208960 00000100:00100000:0.0:1787603937.242052:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355208960 00000100:00100000:0.0:1787603937.242107:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787603937.242119:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355208960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603937.242175:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355208960:12345-0@lo:400:kworker.0 Request processed in 58us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603937.242183:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787603937.242220:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355209472 00000100:00100000:0.0:1787603937.242225:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355209472 00000100:00100000:0.0:1787603937.242265:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787603937.242272:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355209472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603937.242313:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355209472:12345-0@lo:400:kworker.0 Request processed in 42us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603937.242319:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787603937.242337:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787603937.242355:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355209216:0@lo:400:kworker.0 00000100:00100000:3.0:1787603937.242371:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355209344:0@lo:400:kworker.0 00000100:00100000:0.0:1787603937.242382:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603937.242412:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603937.242478:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355208832 00000100:00100000:1.0:1787603937.242483:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355208832 00000100:00100000:1.0:1787603937.242520:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787603937.242528:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355208832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787603937.242563:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603937.242604:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355208832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (2611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603937.242611:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787603937.242646:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787603937.242671:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355208960:0@lo:400:kworker.0 00010000:00080000:1.0:1787603937.242687:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b6138a80 x1874438355209472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603937.242700:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355209472:0@lo:400:kworker.0 00010000:00080000:1.0:1787603937.242736:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed290176d80 x1874438355208832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603937.242750:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355208832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603937.246188:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355209088 00000100:00100000:0.0:1787603937.246208:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355209088 00000100:00100000:1.0:1787603937.249831:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355209216 00000100:00100000:1.0:1787603937.249864:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355209216 00000100:00100000:1.0:1787603937.249890:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355209344 00000100:00100000:1.0:1787603937.249892:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355209344 00000100:00100000:1.0:1787603937.249913:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787603937.249924:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355209088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603937.250023:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355209088:12345-0@lo:400:kworker.0 Request processed in 101us (8042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603937.250038:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787603937.250068:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787603937.250074:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355209216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603937.250113:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355209216:12345-0@lo:400:kworker.0 Request processed in 39us (7731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603937.250119:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787603937.250131:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787603937.250137:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355209344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603937.250170:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355209344:12345-0@lo:400:kworker.0 Request processed in 34us (7759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603937.250176:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787603937.250221:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355209344:0@lo:400:kworker.0 00000100:00080000:1.0:1787603937.250250:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603937.250270:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355209088:0@lo:400:kworker.0 00000100:00100000:1.0:1787603937.250295:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355209216:0@lo:400:kworker.0 00010000:00010000:3.0:1787603937.699307:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787603937.758723:0:8081:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 270822883190ns, next at 271822880905ns, rc = 0 00000100:00100000:1.0:1787603937.758874:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787603937.758895:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355209600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787603937.758963:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603937.759382:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355209600 00000100:00100000:3.0:1787603937.759391:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355209600 00000100:00100000:3.0:1787603937.759479:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787603937.759490:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355209600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787603937.759526:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603937.759633:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355209600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603937.759640:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787603937.759758:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2ba1a9f80 x1874438355209600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603937.759787:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355209600:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787603938.712650:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787603938.989485:0:11598:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787603939.736398:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787603939.862809:0:11647:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd517bc2e0 20000000:00000080:0.0:1787603939.862828:0:11647:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ed2bf42b800 uarg=0000000000000000 20000000:01000000:0.0:1787603939.862999:0:11647:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787603939.863087:0:11647:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787603939.863094:0:11647:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787603939.863777:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787603939.864826:0:11647:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787603939.872587:0:11647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787603939.872660:0:11647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787603939.872755:0:11647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787603939.872774:0:11647:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787603939.872797:0:11647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.872820:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b5dad000/0xb5d1f3b1a19014f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a2 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.873292:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a19014fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a9 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.873301:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b5dad600/0xb5d1f3b1a190150a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901503 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.873308:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901518 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901511 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.873315:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b4963200/0xb5d1f3b1a1901526 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190151f expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.873324:0:11647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.873373:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b4963200/0xb5d1f3b1a1901526 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190151f expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.873388:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2b4963200/0xb5d1f3b1a1901526 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190151f expref: 18 pid: 5815 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603939.873403:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874438355209728:0@lo:104: 00000100:00100000:2.0:1787603939.873467:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787603939.873572:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a1901511 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.873580:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901518 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901511 expref: 18 pid: 5815 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603939.873601:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874438355209856:0@lo:104: 00000100:00100000:2.0:1787603939.873624:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1787603939.874352:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1787603939.874400:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1787603939.874417:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787603939.874540:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355209984:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787603939.874600:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603939.875178:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355209984 00000100:00100000:0.0:1787603939.875188:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355209984 00000100:00100000:0.0:1787603939.875262:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787603939.875274:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355209984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787603939.875308:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787603939.875345:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8cabde, atime: 0x6a8cabde, ctime: 0x6a8cabde, blocks: 0x1 00010000:00010000:0.0:1787603939.875353:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aed56793/0xb5d1f3b1a190165a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.875382:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=272s v=(0 0) 00010000:00010000:0.0:1787603939.875387:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787603939.875395:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aed56793/0xb5d1f3b1a190165a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.875412:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aed56793/0xb5d1f3b1a190165a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.875423:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aed56793/0xb5d1f3b1a190165a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.875430:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aed56793/0xb5d1f3b1a190165a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.875448:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787603939.876152:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355209984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 877us (1549us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787603939.876162:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787603939.876197:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787603939.876204:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aed56793/0xb5d1f3b1a190165a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.876214:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595a00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787603939.876219:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aed56793/0xb5d1f3b1a190165a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.876242:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aed56793/0xb5d1f3b1a190165a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.876262:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aed56793/0xb5d1f3b1a190165a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.876271:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aed56793/0xb5d1f3b1a190165a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.876289:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603939.876290:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603939.876292:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787603939.876335:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2b613ad80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787603939.876342:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355209984:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1787603939.876494:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787603939.877108:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355209728 00000100:00100000:3.0:1787603939.877117:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355209728 00000100:00100000:1.0:1787603939.877141:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355209856 00000100:00100000:1.0:1787603939.877149:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355209856 00000100:00100000:3.0:1787603939.877167:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787603939.877204:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+4:11647:x1874438355209728:12345-0@lo:104: 00010000:00010000:3.0:1787603939.877223:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901526 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603939.877284:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787603939.877291:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+4:11647:x1874438355209728:12345-0@lo:104: Request processed in 91us (3824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603939.877297:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787603939.877306:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787603939.877315:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901526 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603939.877317:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787603939.877326:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+3:11647:x1874438355209856:12345-0@lo:104: 00010000:00010000:1.0:1787603939.877328:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad400 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:1.0:1787603939.877336:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1901526 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603939.877337:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901518 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603939.877357:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1901526 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787603939.877367:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1901526 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603939.877374:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787603939.877386:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787603939.877400:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+3:11647:x1874438355209856:12345-0@lo:104: Request processed in 68us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603939.877421:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787603939.877446:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603939.877452:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1901518 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603939.877459:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e600 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603939.877462:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1901518 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603939.877477:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1901518 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603939.877484:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1901518 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603939.877490:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787603939.877568:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b5dad600/0xb5d1f3b1a190150a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a1901503 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.877583:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ed2b5dad600/0xb5d1f3b1a190150a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901503 expref: 18 pid: 5813 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603939.877597:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874438355210112:0@lo:104: 00000100:00100000:2.0:1787603939.877639:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787603939.877678:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a19014fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a9 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.877690:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a19014fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a9 expref: 12 pid: 5815 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603939.877700:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874438355210240:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603939.877887:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901526 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603939.877895:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787603939.877911:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901526 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603939.877918:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dad400/0xb5d1f3b1a190151f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901526 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603939.877929:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603939.877931:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603939.877933:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603939.877943:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355210368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787603939.877984:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787603939.878090:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b5dad000/0xb5d1f3b1a19014f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a2 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.878100:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2b5dad000/0xb5d1f3b1a19014f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a2 expref: 12 pid: 5815 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603939.878110:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874438355210496:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787603939.878217:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355210368 00000100:00100000:1.0:1787603939.878223:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355210368 00010000:00010000:1.0:1787603939.878243:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b4963200/0xb5d1f3b1a1901526 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190151f expref: 19 pid: 5815 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603939.878270:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787603939.878278:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355210368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787603939.878289:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603939.878295:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b4963200/0xb5d1f3b1a1901526 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190151f expref: 19 pid: 5815 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603939.878306:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b4963200/0xb5d1f3b1a1901526 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190151f expref: 19 pid: 5815 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603939.878324:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603939.878354:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355210368:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603939.878361:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787603939.878396:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355210368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787603939.878426:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787603939.878438:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355210112 00000100:00100000:1.0:1787603939.878441:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355210112 00000100:00100000:1.0:1787603939.878465:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787603939.878471:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf359c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+3:11647:x1874438355210112:12345-0@lo:104: 00010000:00010000:1.0:1787603939.878480:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a190150a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603939.878529:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787603939.878534:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf359c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9a643876-f930-492c-81cb-9dcff9ce6b60+3:11647:x1874438355210112:12345-0@lo:104: Request processed in 63us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603939.878541:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787603939.879934:0:11647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2985b7600 going to sleep for 11 seconds 00010000:00010000:2.0:1787603939.879973:0:11647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b4963200/0xb5d1f3b1a1901526 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190151f expref: 18 pid: 5815 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603939.880135:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874438355209728:0@lo:104: 00000100:00100000:2.0:1787603939.880151:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874438355209856:0@lo:104: 00000100:00100000:2.0:1787603939.880159:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874438355210112:0@lo:104: 00010000:00010000:3.0:1787603939.880400:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901518 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603939.880409:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603939.880450:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901518 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603939.880457:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e600/0xb5d1f3b1a1901511 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1901518 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603939.880472:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603939.880476:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a190150a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603939.880493:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac400 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787603939.880497:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a190150a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603939.880506:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a190150a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787603939.880513:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a190150a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787603939.880519:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787603939.880543:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190150a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603939.880550:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787603939.880556:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190150a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603939.880561:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1901503 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190150a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603939.880575:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603939.880577:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603939.880578:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603939.880628:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355210624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787603939.880690:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603939.880737:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787603939.880744:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355210752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787603939.880769:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603939.880800:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355210624 00000100:00100000:2.0:1787603939.880807:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355210624 00010000:00010000:2.0:1787603939.880833:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901518 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901511 expref: 18 pid: 5815 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.881629:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603939.881968:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355210752 00000100:00100000:2.0:1787603939.881974:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355210752 00010000:00010000:2.0:1787603939.881998:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b5dad600/0xb5d1f3b1a190150a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901503 expref: 19 pid: 5813 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603939.883100:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787603939.883121:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355210624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787603939.883146:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603939.883155:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901518 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901511 expref: 19 pid: 5815 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.883169:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901511 expref: 19 pid: 5815 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.883191:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901518 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a1901511 expref: 19 pid: 5815 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.883229:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603939.883325:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:3283:x1874438355210624:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603939.883332:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787603939.883359:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787603939.883366:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa48c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+17:3283:x1874438355210752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787603939.883375:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603939.883380:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b5dad600/0xb5d1f3b1a190150a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901503 expref: 17 pid: 5813 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603939.883387:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355210624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787603939.883394:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b5dad600/0xb5d1f3b1a190150a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a1901503 expref: 17 pid: 5813 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.883407:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5dad600/0xb5d1f3b1a190150a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a1901503 expref: 17 pid: 5813 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.883417:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603939.883464:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa48c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+16:3283:x1874438355210752:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (2694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603939.883471:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787603939.883507:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355210752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787603939.884650:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603939.884674:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874438355210240:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787603939.884692:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874438355210496:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787603939.884731:0:11647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603939.884759:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603939.884781:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345741184 00000100:00100000:0.0:1787603939.884789:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345741184 00010000:00010000:0.0:1787603939.884821:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a19014fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a9 expref: 13 pid: 5815 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603939.884888:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345741312 00000100:00100000:0.0:1787603939.884892:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345741312 00010000:00010000:0.0:1787603939.884905:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b5dad000/0xb5d1f3b1a19014f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a2 expref: 14 pid: 5815 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603939.884942:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 33 00000100:00100000:0.0:1787603939.884952:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+14:2364:x1874438345741184:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787603939.884964:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603939.884970:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a19014fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a9 expref: 14 pid: 5815 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.884981:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a19014fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a9 expref: 14 pid: 5815 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.884998:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a19014fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a9 expref: 14 pid: 5815 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885010:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603939.885072:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2364:x1874438345741184:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 121us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603939.885080:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 33 00000100:00100000:0.0:1787603939.885097:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 34 00000100:00100000:0.0:1787603939.885103:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+12:2363:x1874438345741312:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787603939.885110:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603939.885115:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b5dad000/0xb5d1f3b1a19014f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a2 expref: 12 pid: 5815 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885124:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b5dad000/0xb5d1f3b1a19014f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a2 expref: 12 pid: 5815 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885134:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5dad000/0xb5d1f3b1a19014f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59a2 expref: 12 pid: 5815 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885154:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885164:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885180:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885187:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885195:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885202:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885209:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962a00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787603939.885214:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885222:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885233:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603939.885242:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603939.885263:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+11:2363:x1874438345741312:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 160us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603939.885275:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 34 00010000:00010000:2.0:1787603939.886492:0:11647:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.886504:0:11647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603939.886525:0:11647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1901653 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603940.136631:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603940.136677:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603940.136797:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345741568 00000100:00100000:0.0:1787603940.136808:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345741568 00000100:00100000:0.0:1787603940.136933:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 44 00000100:00100000:0.0:1787603940.136943:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345741568:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603940.137036:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345741568:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 93us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603940.137043:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 44 00000100:00100000:1.0:1787603940.137197:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345741440 00000100:00100000:1.0:1787603940.137202:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345741440 00000100:00100000:0.0:1787603940.139229:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603940.139327:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345741696 00000100:00100000:3.0:1787603940.139337:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345741696 00000100:00080000:2.0:1787603940.139425:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787603940.139429:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787603940.139610:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 100 00000100:00100000:1.0:1787603940.139624:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345741440:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603940.139703:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345741440:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (3085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603940.139709:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 100 00000100:00100000:3.0:1787603940.140994:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 101 00000100:00100000:3.0:1787603940.141005:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345741696:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603940.141072:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345741696:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 69us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603940.141090:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 101 00010000:00010000:1.0:1787603940.759099:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603941.782999:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787603941.783216:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787603941.783221:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed2b4d09000 from 7 10000000:01000000:1.0:1787603941.783227:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787603941.783287:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603941.783300:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603941.783312:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603941.783355:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355210880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787603941.783504:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603941.783680:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787603941.786274:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355210880 00000100:00100000:3.0:1787603941.786297:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355210880 00000100:00100000:3.0:1787603941.786385:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787603941.786397:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+16:5818:x1874438355210880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787603941.786429:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603941.786455:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dac400/0xb5d1f3b1a1901668 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1901661 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603941.786489:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dac400/0xb5d1f3b1a1901668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901661 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603941.786502:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b5dac400/0xb5d1f3b1a1901668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1901661 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603941.786512:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac400, rc 0) 00000100:00100000:3.0:1787603941.786618:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355210880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603941.786626:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787603941.786893:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355210880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787603941.786915:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603941.786925:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603941.787028:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355211008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603941.787067:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603941.787120:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787603941.787339:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355211008 00000100:00100000:0.0:1787603941.787345:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355211008 00000100:00100000:0.0:1787603941.787384:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787603941.787393:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355211008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787603941.787665:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355211008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603941.787673:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787603941.787876:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355211008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603941.787922:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355211136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787603941.787959:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603941.787996:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603941.788056:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355211136 00000100:00100000:2.0:1787603941.788061:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355211136 00000100:00100000:2.0:1787603941.788095:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787603941.788104:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355211136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787603941.788271:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355211136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603941.788278:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787603941.788369:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355211136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787603941.788834:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:11661:1874438355211264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603941.788896:0:11661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603941.788929:0:11661:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf51dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787603941.789542:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355211264 00000100:00100000:2.0:1787603941.789630:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355211264 00000100:00100000:2.0:1787603941.789691:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787603941.789702:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:11661:x1874438355211264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603941.790055:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:11661:x1874438355211264:12345-0@lo:502:llog_process_th.0 Request processed in 276us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603941.790064:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787603941.790354:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:11661:1874438355211264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787603941.790385:0:11661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787603941.790396:0:11661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787603941.790398:0:11661:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787603941.790405:0:11661:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ed2b4d09000 00000020:00000080:1.0:1787603941.790407:0:11661:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787603941.790667:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:11661:1874438355211392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787603941.790714:0:11661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603941.790754:0:11661:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603941.792090:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355211392 00000100:00100000:2.0:1787603941.792100:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355211392 00000100:00100000:2.0:1787603941.792225:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787603941.792236:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:11661:x1874438355211392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603941.793284:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:11661:x1874438355211392:12345-0@lo:502:llog_process_th.0 Request processed in 1043us (2562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603941.793304:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787603941.793506:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:11661:1874438355211392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787603941.793548:0:11661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787603941.793636:0:11661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787603941.793639:0:11661:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787603941.793644:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787603941.793825:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787603941.793878:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787603941.793891:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603941.793902:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787603941.793912:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787603941.793916:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed286a76000 from 7 10000000:01000000:0.0:1787603941.793919:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787603941.793967:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603941.794056:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603941.794070:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603941.794092:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af051c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355211520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787603941.794694:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603941.794744:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b5c7f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787603941.795224:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355211520 00000100:00100000:2.0:1787603941.795233:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355211520 00000100:00100000:2.0:1787603941.795279:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787603941.795290:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+17:5818:x1874438355211520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787603941.795306:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603941.795325:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b4963800/0xb5d1f3b1a1901676 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190166f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603941.795357:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4963800/0xb5d1f3b1a1901676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190166f expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603941.795369:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b4963800/0xb5d1f3b1a1901676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190166f expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603941.795379:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963800, rc 0) 00000100:00100000:2.0:1787603941.797648:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355211520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2352us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603941.797660:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787603941.797898:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af051c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355211520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787603941.797924:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603941.797937:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603941.798677:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af051c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355211648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787603941.798734:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603941.798779:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b5c7f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787603941.799673:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355211648 00000100:00100000:2.0:1787603941.799685:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355211648 00000100:00100000:2.0:1787603941.799739:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787603941.799749:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355211648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603941.805687:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355211648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5930us (6943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603941.805702:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787603941.806136:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af051c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355211648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603941.806206:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355211776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787603941.806261:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603941.806297:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787603941.806443:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355211776 00000100:00100000:3.0:1787603941.806452:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355211776 00000100:00100000:3.0:1787603941.806513:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787603941.806525:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355211776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787603941.806945:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ef1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355211776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 422us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603941.806954:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787603941.807099:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355211776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787603941.812330:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:11663:1874438355211904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603941.812441:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603941.812489:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf51dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603941.812647:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355211904 00000100:00100000:1.0:1787603941.812658:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355211904 00000100:00100000:1.0:1787603941.812713:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787603941.812724:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:11663:x1874438355211904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787603941.812968:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:11663:x1874438355211904:12345-0@lo:502:llog_process_th.0 Request processed in 245us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603941.813054:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787603941.813543:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:11663:1874438355211904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787603941.813752:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787603941.813762:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603941.813765:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787603941.813772:0:11663:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ed286a76000 00000020:00000080:3.0:1787603941.813774:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787603941.813896:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:11663:1874438355212032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603941.813942:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603941.813966:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf51dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603941.814204:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355212032 00000100:00100000:2.0:1787603941.814218:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355212032 00000100:00100000:2.0:1787603941.814255:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787603941.814265:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:11663:x1874438355212032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603941.815324:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+18:11663:x1874438355212032:12345-0@lo:502:llog_process_th.0 Request processed in 1056us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603941.815335:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787603941.815796:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:11663:1874438355212032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787603941.815829:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603941.816502:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603941.816507:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787603941.816514:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787603941.818295:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787603941.818323:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787603941.818335:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603941.818348:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787603941.818376:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787603941.818379:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed29010d000 from 7 10000000:01000000:1.0:1787603941.818382:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787603941.819653:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603941.819668:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603941.819684:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603941.819717:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355212160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787603941.819789:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603941.819856:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2840 going to sleep for 11 seconds 00000100:00100000:3.0:1787603941.820538:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355212160 00000100:00100000:3.0:1787603941.821060:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355212160 00000100:00100000:3.0:1787603941.821512:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787603941.821527:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:5818:x1874438355212160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787603941.821547:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603941.821776:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901684 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190167d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603941.821816:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190167d expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603941.821826:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190167d expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603941.821854:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dade00, rc 0) 00000100:00100000:3.0:1787603941.821923:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355212160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 399us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603941.821930:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787603941.822352:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355212160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787603941.822374:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603941.822385:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603941.823509:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355212288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603941.824091:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603941.824523:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787603941.824750:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355212288 00000100:00100000:2.0:1787603941.824760:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355212288 00000100:00100000:2.0:1787603941.824821:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787603941.824833:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355212288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603941.826486:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355212288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1647us (2387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603941.826500:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787603941.835993:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355212288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787603941.836076:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355212416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787603941.836539:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603941.836779:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787603941.836872:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355212416 00000100:00100000:2.0:1787603941.836880:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355212416 00000100:00100000:2.0:1787603941.836933:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787603941.836944:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355212416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787603941.837368:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:5818:x1874438355212416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 425us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603941.837376:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787603941.837703:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9a643876-f930-492c-81cb-9dcff9ce6b60:5818:1874438355212416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787603941.844759:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:11665:1874438355212544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603941.844883:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603941.844936:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf51de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787603941.845038:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355212544 00000100:00100000:2.0:1787603941.845047:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355212544 00000100:00100000:2.0:1787603941.845102:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787603941.845113:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:11665:x1874438355212544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787603941.845341:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:11665:x1874438355212544:12345-0@lo:502:llog_process_th.0 Request processed in 228us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603941.845358:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787603941.845518:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:11665:1874438355212544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787603941.845549:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787603941.845558:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603941.845561:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787603941.845568:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ed29010d000 00000020:00000080:3.0:1787603941.845571:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787603941.845657:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:11665:1874438355212672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603941.845690:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603941.845704:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf51de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787603941.846217:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355212672 00000100:00100000:3.0:1787603941.846224:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355212672 00000100:00100000:3.0:1787603941.846259:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787603941.846267:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:11665:x1874438355212672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787603941.846448:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:11665:x1874438355212672:12345-0@lo:502:llog_process_th.0 Request processed in 179us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603941.846455:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787603941.846502:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9a643876-f930-492c-81cb-9dcff9ce6b60:11665:1874438355212672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787603941.846526:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787603941.846531:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787603941.846533:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787603941.846537:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787603941.846995:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787603941.847026:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787603941.847038:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603941.847050:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787603941.850236:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787603941.864598:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603941.864684:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345741824 00000100:00100000:3.0:1787603941.864697:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345741824 00000100:00100000:3.0:1787603941.864769:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 264 00000100:00100000:3.0:1787603941.864782:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+11:5608:x1874438345741824:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787603941.864804:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603941.864825:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a190168b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59f6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603941.864878:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a190168b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59f6 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603941.864891:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a190168b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59f6 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603941.864902:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5daca00, rc 0) 00000100:00100000:3.0:1787603941.864971:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+12:5608:x1874438345741824:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 Request processed in 191us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603941.864987:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 264 00000100:00100000:3.0:1787603941.867615:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603941.868144:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345741952 00000100:00100000:2.0:1787603941.868158:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345741952 00000100:00100000:2.0:1787603941.868221:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 265 00000100:00100000:2.0:1787603941.868234:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+12:5608:x1874438345741952:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603941.868592:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+12:5608:x1874438345741952:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 Request processed in 359us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603941.868601:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 265 00000100:00100000:2.0:1787603941.873881:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603941.873961:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345742080 00000100:00100000:3.0:1787603941.874045:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345742080 00000100:00100000:3.0:1787603941.874166:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 266 00000100:00100000:3.0:1787603941.874178:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+12:5608:x1874438345742080:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787603941.874433:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+12:5608:x1874438345742080:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 Request processed in 256us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603941.874441:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 266 00000100:00100000:3.0:1787603941.878385:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603941.878683:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345742208 00000100:00100000:2.0:1787603941.878695:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345742208 00000100:00100000:2.0:1787603941.878763:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 267 00000100:00100000:2.0:1787603941.878775:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+12:9962:x1874438345742208:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787603941.879216:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+12:9962:x1874438345742208:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 441us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603941.879225:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 267 00000100:00100000:2.0:1787603941.886728:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603941.887814:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345742336 00000100:00100000:3.0:1787603941.887830:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345742336 00000100:00100000:3.0:1787603941.887924:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 268 00000100:00100000:3.0:1787603941.887936:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+12:9962:x1874438345742336:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787603941.888210:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+12:9962:x1874438345742336:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 275us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603941.888219:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 268 00000100:00100000:3.0:1787603941.903950:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603941.904688:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345742464 00000100:00100000:0.0:1787603941.904705:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345742464 00000100:00100000:0.0:1787603941.904763:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 269 00000100:00100000:0.0:1787603941.904776:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+12:5608:x1874438345742464:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787603941.904800:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603941.904830:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298595a00/0xb5d1f3b1a1901692 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e59fd expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603941.904877:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298595a00/0xb5d1f3b1a1901692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59fd expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603941.904891:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298595a00/0xb5d1f3b1a1901692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59fd expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603941.904902:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595a00, rc 0) 00000100:00100000:0.0:1787603941.904972:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:5608:x1874438345742464:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 Request processed in 198us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603941.904979:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 269 00000100:00100000:3.0:1787603941.914334:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603941.914490:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345742592 00000100:00100000:2.0:1787603941.914503:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345742592 00000100:00100000:2.0:1787603941.914569:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 270 00000100:00100000:2.0:1787603941.914580:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:5608:x1874438345742592:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787603941.914891:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:5608:x1874438345742592:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 Request processed in 311us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603941.914901:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 270 00000100:00100000:1.0:1787603941.919215:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603941.919308:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345742720 00000100:00100000:3.0:1787603941.919321:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345742720 00000100:00100000:3.0:1787603941.919379:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 271 00000100:00100000:3.0:1787603941.919390:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:5608:x1874438345742720:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787603941.919658:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:5608:x1874438345742720:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 Request processed in 268us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603941.919667:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 271 00000100:00100000:3.0:1787603941.927076:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603941.927553:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345742848 00000100:00100000:2.0:1787603941.927566:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345742848 00000100:00100000:3.0:1787603941.927693:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 272 00000100:00100000:3.0:1787603941.927723:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:9965:x1874438345742848:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787603941.928161:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:9965:x1874438345742848:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 440us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603941.928170:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 272 00000100:00100000:0.0:1787603941.935706:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603941.937511:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345742976 00000100:00100000:3.0:1787603941.937527:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345742976 00000100:00100000:3.0:1787603941.938319:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 273 00000100:00100000:3.0:1787603941.938335:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:9965:x1874438345742976:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787603941.939472:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:9965:x1874438345742976:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 1134us (3766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603941.939487:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 273 00000100:00100000:0.0:1787603942.359516:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355212800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787603942.359562:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355213184:0@lo:400:kworker.0 00000100:00100000:1.0:1787603942.359600:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603942.359600:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603942.359642:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355213056:0@lo:400:kworker.0 00000100:00100000:0.0:1787603942.359662:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355213312:0@lo:400:kworker.0 00000100:00100000:2.0:1787603942.359663:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355212928:0@lo:400:kworker.0 00000100:00100000:0.0:1787603942.359691:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603942.359717:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603942.359736:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355212800 00000100:00100000:0.0:1787603942.359741:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355213312 00000100:00100000:1.0:1787603942.359745:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355212800 00000100:00100000:0.0:1787603942.359745:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355213312 00000100:00100000:2.0:1787603942.359750:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355213440:0@lo:400:kworker.0 00000100:00100000:2.0:1787603942.359775:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603942.359804:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787603942.359804:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787603942.359815:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355212800:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603942.359815:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355213312:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787603942.359824:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787603942.359880:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355213184 00002000:00000024:1.0:1787603942.359881:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787603942.359886:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355213184 00000100:00100000:0.0:1787603942.359891:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355213312:12345-0@lo:400:kworker.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603942.359900:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787603942.359917:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355212800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603942.359924:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787603942.359932:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355213440 00000100:00100000:2.0:1787603942.359936:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355213440 00010000:00080000:0.0:1787603942.359953:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b6138a80 x1874438355213312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603942.359964:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787603942.359971:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355213184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603942.359992:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355213312:0@lo:400:kworker.0 00010000:00080000:0.0:1787603942.360015:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2ba1a9c00 x1874438355212800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603942.360025:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355213184:12345-0@lo:400:kworker.0 Request processed in 53us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603942.360031:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355212800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787603942.360038:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787603942.360057:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787603942.360066:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355213440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603942.360097:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355213440:12345-0@lo:400:kworker.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603942.360110:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787603942.365670:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355213184:0@lo:400:kworker.0 00000100:00100000:1.0:1787603942.367543:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355213440:0@lo:400:kworker.0 00000100:00080000:1.0:1787603942.367589:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603942.367623:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355212928 00000100:00100000:1.0:1787603942.367631:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355212928 00000100:00100000:1.0:1787603942.367698:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787603942.367708:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2985b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355212928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603942.367807:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2985b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355212928:12345-0@lo:400:kworker.0 Request processed in 100us (8092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603942.367815:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787603942.367886:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355212928:0@lo:400:kworker.0 00000100:00100000:1.0:1787603942.367927:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603942.367992:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355213568:0@lo:400:kworker.0 00000100:00100000:1.0:1787603942.368037:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603942.368076:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355213056 00000100:00100000:1.0:1787603942.368081:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355213056 00000100:00100000:0.0:1787603942.371143:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355213568 00000100:00100000:0.0:1787603942.371161:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355213568 00000100:00100000:0.0:1787603942.371245:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787603942.371257:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3283:x1874438355213568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603942.371363:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3283:x1874438355213568:12345-0@lo:400:kworker.0 Request processed in 108us (3325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603942.371370:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787603942.371397:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787603942.371450:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355213568:0@lo:400:kworker.0 00000100:00100000:1.0:1787603942.371806:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787603942.371817:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355213056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603942.371877:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355213056:12345-0@lo:400:kworker.0 Request processed in 62us (3949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603942.371882:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787603942.371932:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355213056:0@lo:400:kworker.0 00010000:00010000:0.0:1787603942.809832:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787603942.872508:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787603942.873014:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355213696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787603942.873116:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603942.873282:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355213696 00000100:00100000:2.0:1787603942.873291:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355213696 00000100:00100000:2.0:1787603942.873356:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787603942.873368:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1874438355213696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787603942.873408:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787603942.873464:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1874438355213696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603942.873471:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787603942.873671:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355213696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787603943.831319:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603944.855396:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787603944.970918:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:1.0:1787603945.256314:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603945.256372:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603945.256400:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603945.256437:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603945.256466:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345743104 00000100:00100000:3.0:1787603945.256478:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345743104 00000100:00100000:3.0:1787603945.256547:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 275 00000100:00100000:3.0:1787603945.256560:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345743104:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603945.256639:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345743104:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603945.256647:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 275 00000100:00100000:0.0:1787603945.256749:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345743360 00000100:00100000:0.0:1787603945.256753:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345743360 00000100:00100000:0.0:1787603945.256807:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 47 00000100:00100000:0.0:1787603945.256815:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2365:x1874438345743360:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603945.256877:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2365:x1874438345743360:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 63us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603945.256885:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 47 00000100:00100000:0.0:1787603945.257015:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345743232 00000100:00100000:0.0:1787603945.257019:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345743232 00000100:00100000:0.0:1787603945.257061:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345743488 00000100:00100000:0.0:1787603945.257065:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345743488 00000100:00100000:0.0:1787603945.257090:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 105 00000100:00100000:0.0:1787603945.257097:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345743232:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603945.257137:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345743232:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 41us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603945.257144:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 105 00000100:00100000:0.0:1787603945.257157:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 106 00000100:00100000:0.0:1787603945.257164:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2366:x1874438345743488:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603945.257190:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2366:x1874438345743488:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 26us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603945.257197:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 106 00000100:00080000:3.0:1787603945.257490:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787603945.257496:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787603945.879477:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603946.903531:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603947.479429:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355213824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603947.479527:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603947.479696:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355213824 00000100:00100000:2.0:1787603947.479706:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355213824 00000100:00100000:2.0:1787603947.479804:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787603947.479817:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355213824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787603947.479885:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787603947.479943:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355213824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603947.479977:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787603947.480166:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2ba1aa300 x1874438355213824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603947.480187:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355213824:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787603947.480255:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787603947.483927:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355213952:0@lo:400:kworker.0 00000100:00100000:1.0:1787603947.484045:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603947.484287:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355214208:0@lo:400:kworker.0 00000100:00100000:3.0:1787603947.484334:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603947.484365:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787603947.484371:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355214080:0@lo:400:kworker.0 00000100:00100000:3.0:1787603947.484396:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603947.484431:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355214208 00000100:00100000:3.0:1787603947.484440:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355214208 00000100:00100000:3.0:1787603947.484499:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355214080 00000100:00100000:3.0:1787603947.484502:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355214080 00000100:00100000:3.0:1787603947.484525:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787603947.484535:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355214208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603947.484594:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355214208:12345-0@lo:400:kworker.0 Request processed in 59us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603947.484602:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787603947.484621:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787603947.484627:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355214080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603947.484655:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355214080:12345-0@lo:400:kworker.0 Request processed in 29us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603947.484662:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787603947.484677:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603947.484710:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355214080:0@lo:400:kworker.0 00000100:00100000:3.0:1787603947.484720:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355214208:0@lo:400:kworker.0 00000100:00100000:3.0:1787603947.484745:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355214336:0@lo:400:kworker.0 00000100:00100000:3.0:1787603947.484769:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603947.484794:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355214336 00000100:00100000:3.0:1787603947.484814:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355214336 00000100:00100000:3.0:1787603947.484862:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787603947.484870:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355214336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603947.484903:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355214336:12345-0@lo:400:kworker.0 Request processed in 35us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603947.484909:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1787603947.484922:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603947.484937:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355214336:0@lo:400:kworker.0 00000100:00100000:0.0:1787603947.485071:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355213952 00000100:00100000:0.0:1787603947.485076:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355213952 00000100:00100000:0.0:1787603947.485113:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787603947.485120:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355213952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603947.491866:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787603947.491888:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355214464:0@lo:400:kworker.0 00000100:00100000:3.0:1787603947.491993:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603947.492266:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355214464 00000100:00100000:2.0:1787603947.492277:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355214464 00000100:00100000:2.0:1787603947.492361:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787603947.492373:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355214464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603947.492439:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355214464:12345-0@lo:400:kworker.0 Request processed in 69us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603947.492447:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787603947.492488:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787603947.492508:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2b613ad80, transno 4294967300 00000100:00100000:2.0:1787603947.492523:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355214464:0@lo:400:kworker.0 00000100:00080000:3.0:1787603947.492950:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787603947.501552:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355213952:12345-0@lo:400:kworker.0 Request processed in 16418us (17492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603947.501571:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787603947.501773:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355213952:0@lo:400:kworker.0 00010000:00010000:3.0:1787603947.928180:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603947.991537:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355214592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787603947.991617:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603947.992111:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355214592 00000100:00100000:3.0:1787603947.992123:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355214592 00000100:00100000:3.0:1787603947.992187:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787603947.992198:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355214592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787603947.992240:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603947.992318:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355214592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603947.992326:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787603947.992528:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355214592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787603948.951224:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603949.975314:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603950.385299:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603950.385347:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603950.385405:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603950.387065:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345743616 00000100:00100000:0.0:1787603950.387079:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345743616 00000100:00100000:0.0:1787603950.387142:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 277 00000100:00100000:0.0:1787603950.387154:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2363:x1874438345743616:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603950.387240:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2363:x1874438345743616:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 87us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603950.387248:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 277 00000100:00100000:1.0:1787603950.388059:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603950.388098:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345743872 00000100:00100000:1.0:1787603950.388105:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345743872 00000100:00100000:1.0:1787603950.388155:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 49 00000100:00100000:1.0:1787603950.388165:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345743872:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603950.388215:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345743872:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 52us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603950.388222:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 49 00000100:00100000:1.0:1787603950.388243:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345743744 00000100:00100000:1.0:1787603950.388247:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345743744 00000100:00100000:1.0:1787603950.388271:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345744000 00000100:00100000:1.0:1787603950.388274:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345744000 00000100:00100000:1.0:1787603950.388293:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 110 00000100:00100000:1.0:1787603950.388299:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345743744:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603950.388327:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345743744:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 28us (2922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603950.388333:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 110 00000100:00100000:1.0:1787603950.388344:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 111 00000100:00100000:1.0:1787603950.388351:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2363:x1874438345744000:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603950.388374:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2363:x1874438345744000:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 23us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603950.388379:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 111 00000100:00080000:1.0:1787603950.388409:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787603950.388413:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787603950.999379:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603952.024585:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787603952.091288:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787603952.599290:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787603952.599321:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355214720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603952.599431:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603952.599591:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355214720 00000100:00100000:3.0:1787603952.599601:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355214720 00000100:00100000:3.0:1787603952.599681:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787603952.599693:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355214720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787603952.599732:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603952.599799:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355214720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603952.599808:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787603952.599914:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787603952.599950:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2ba1abb80 x1874438355214720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603952.599969:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355214720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787603952.600361:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b606e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355214848:0@lo:400:kworker.0 00000100:00100000:2.0:1787603952.600400:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603952.600433:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355215360:0@lo:400:kworker.0 00000100:00100000:2.0:1787603952.600458:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603952.600479:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787603952.600485:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355214976:0@lo:400:kworker.0 00000100:00100000:2.0:1787603952.600509:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603952.600536:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355215360 00000100:00100000:2.0:1787603952.600541:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355215360 00000100:00100000:2.0:1787603952.600577:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787603952.600584:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355215360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603952.600624:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355215360:12345-0@lo:400:kworker.0 Request processed in 40us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603952.600629:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787603952.600650:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355214976 00000100:00100000:2.0:1787603952.600654:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355214976 00000100:00100000:2.0:1787603952.600678:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787603952.600685:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355214976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603952.600715:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355214976:12345-0@lo:400:kworker.0 Request processed in 30us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603952.600722:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787603952.600745:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355215232:0@lo:400:kworker.0 00000100:00100000:2.0:1787603952.600769:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603952.600827:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787603952.600834:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355215104:0@lo:400:kworker.0 00000100:00100000:2.0:1787603952.600881:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603952.600919:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355215232 00000100:00100000:2.0:1787603952.600924:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355215232 00000100:00100000:2.0:1787603952.600947:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355215104 00000100:00100000:2.0:1787603952.600950:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355215104 00000100:00100000:2.0:1787603952.600969:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787603952.600975:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355215232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603952.601008:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355215232:12345-0@lo:400:kworker.0 Request processed in 34us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603952.601014:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787603952.601026:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787603952.601032:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355215104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603952.601059:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355215104:12345-0@lo:400:kworker.0 Request processed in 28us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603952.601065:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1787603952.601084:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787603952.601087:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787603952.601110:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355215104:0@lo:400:kworker.0 00000100:00100000:2.0:1787603952.601119:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355215232:0@lo:400:kworker.0 00000100:00100000:2.0:1787603952.601145:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355214976:0@lo:400:kworker.0 00000100:00100000:2.0:1787603952.601154:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355215360:0@lo:400:kworker.0 00000100:00100000:1.0:1787603952.601263:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355214848 00000100:00100000:1.0:1787603952.601268:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355214848 00000100:00100000:1.0:1787603952.601302:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787603952.601310:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355214848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603952.601352:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355214848:12345-0@lo:400:kworker.0 Request processed in 42us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603952.601358:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787603952.601509:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b606e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355214848:0@lo:400:kworker.0 00010000:00010000:1.0:1787603953.047157:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603953.111270:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787603953.113588:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355215488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787603953.114031:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603953.116099:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355215488 00000100:00100000:3.0:1787603953.116115:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355215488 00000100:00100000:3.0:1787603953.116244:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787603953.116255:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355215488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787603953.116300:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603953.116483:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355215488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 229us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603953.116490:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787603953.116598:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355215488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787603954.071215:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603955.096882:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603955.500863:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603955.500924:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603955.501028:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345744256 00000100:00100000:2.0:1787603955.501041:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345744256 00000100:00100000:2.0:1787603955.501134:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 115 00000100:00100000:2.0:1787603955.501148:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2365:x1874438345744256:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603955.501247:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2365:x1874438345744256:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 102us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603955.501256:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 115 00000100:00100000:3.0:1787603955.501326:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345744128 00000100:00100000:3.0:1787603955.501331:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345744128 00000100:00100000:3.0:1787603955.501369:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 279 00000100:00100000:3.0:1787603955.501376:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345744128:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603955.501406:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345744128:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 31us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603955.501412:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 279 00000100:00080000:0.0:1787603955.501951:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603955.522468:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603955.522535:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603955.522611:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345744384 00000100:00100000:0.0:1787603955.522632:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345744384 00000100:00100000:0.0:1787603955.522758:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:0.0:1787603955.522772:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2362:x1874438345744384:12345-192.168.202.21@tcp:9:kworker.0 00000020:00000080:0.0:1787603955.522833:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19015ce 00000100:00080000:0.0:1787603955.522877:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9ed2b6f7d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787603955.522935:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787603955.523093:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345744512 00000100:00100000:2.0:1787603955.523099:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345744512 00000100:00100000:2.0:1787603955.523144:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 116 00000100:00100000:2.0:1787603955.523153:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2363:x1874438345744512:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603955.523243:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2363:x1874438345744512:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 88us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603955.523253:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 116 00010000:00010000:3.0:1787603955.523284:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603955.523748:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+2:2362:x1874438345744384:12345-192.168.202.21@tcp:9:kworker.0 Request processed in 977us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603955.523757:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00080000:1.0:1787603955.526994:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787603955.527008:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787603956.119797:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603957.143360:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603957.719082:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355215872:0@lo:400:kworker.0 00000100:00100000:1.0:1787603957.719086:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355216000:0@lo:400:kworker.0 00000100:00100000:2.0:1787603957.719321:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355215744:0@lo:400:kworker.0 00000100:00100000:0.0:1787603957.719409:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355215616:0@lo:400:kworker.0 00000100:00100000:3.0:1787603957.719461:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603957.719541:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355215872 00000100:00100000:3.0:1787603957.719621:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355215872 00000100:00100000:3.0:1787603957.719687:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787603957.719699:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355215872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603957.719778:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355215872:12345-0@lo:400:kworker.0 Request processed in 81us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603957.719787:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1787603957.719811:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603957.719860:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355215872:0@lo:400:kworker.0 00000100:00100000:3.0:1787603957.719960:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355216384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603957.719988:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603957.720025:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355216384 00000100:00100000:3.0:1787603957.720029:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355216384 00000100:00100000:3.0:1787603957.720061:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787603957.720068:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355216384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787603957.720100:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603957.720153:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355216384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603957.720160:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787603957.720308:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787603957.720330:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2ba1a9f80 x1874438355216384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603957.720346:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355216384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787603957.724585:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603957.724930:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355216000 00000100:00100000:3.0:1787603957.724942:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355216000 00000100:00100000:3.0:1787603957.725009:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787603957.725021:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355216000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603957.725110:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355216000:12345-0@lo:400:kworker.0 Request processed in 91us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603957.725136:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787603957.725185:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2af7bd880 x1874438355216000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603957.725214:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355216000:0@lo:400:kworker.0 00000100:00100000:2.0:1787603957.726922:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603957.726976:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355216256:0@lo:400:kworker.0 00000100:00100000:2.0:1787603957.727010:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603957.727741:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355216256 00000100:00100000:1.0:1787603957.727752:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355216256 00000100:00100000:1.0:1787603957.727830:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787603957.727874:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355216256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603957.727947:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355216256:12345-0@lo:400:kworker.0 Request processed in 108us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603957.727955:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787603957.728001:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355216256:0@lo:400:kworker.0 00000100:00100000:3.0:1787603957.728309:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355215744 00000100:00100000:3.0:1787603957.728315:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355215744 00000100:00100000:3.0:1787603957.728357:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787603957.728365:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355215744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603957.728409:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355215744:12345-0@lo:400:kworker.0 Request processed in 45us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603957.728415:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787603957.728445:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355215744:0@lo:400:kworker.0 00000100:00080000:2.0:1787603957.729515:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787603957.733143:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603957.733225:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355216128:0@lo:400:kworker.0 00000100:00100000:0.0:1787603957.733268:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603957.733413:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355215616 00000100:00100000:1.0:1787603957.733425:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355215616 00000100:00100000:1.0:1787603957.733489:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787603957.733518:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355215616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603957.733602:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355215616:12345-0@lo:400:kworker.0 Request processed in 86us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603957.733610:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787603957.734326:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355215616:0@lo:400:kworker.0 00000100:00100000:3.0:1787603957.734980:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355216128 00000100:00100000:3.0:1787603957.734989:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355216128 00000100:00100000:3.0:1787603957.735071:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787603957.735083:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355216128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603957.735160:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355216128:12345-0@lo:400:kworker.0 Request processed in 78us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603957.735167:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787603957.735261:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355216128:0@lo:400:kworker.0 00000100:00080000:2.0:1787603957.739792:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787603958.167031:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603958.231989:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787603958.232014:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355216512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787603958.232091:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603958.232228:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355216512 00000100:00100000:3.0:1787603958.232238:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355216512 00000100:00100000:3.0:1787603958.232300:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787603958.232310:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355216512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787603958.232351:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603958.232428:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355216512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603958.232437:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787603958.234099:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355216512:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787603959.191018:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603960.216292:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787603960.341893:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000020:00000080:2.0:1787603960.341913:0:7632:0:(genops.c:885:class_export_put()) final put ffff9ed2b6f7f000/a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000020:00000080:2.0:1787603960.341953:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2b6f7f000/a45d6158-dc8e-48e6-b534-483bf3fa20ad for lustre-OST0001 00000020:00000080:2.0:1787603960.342004:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2b6f7d000 for lustre-OST0001 00000100:00100000:0.0:1787603960.624208:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603960.624256:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345744768 00000100:00100000:0.0:1787603960.624257:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603960.624268:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345744768 00000100:00100000:0.0:1787603960.624286:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603960.624308:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345744640 00000100:00100000:0.0:1787603960.624312:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345744640 00000100:00100000:3.0:1787603960.624336:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345744896 00000100:00100000:3.0:1787603960.624339:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345744896 00000100:00100000:0.0:1787603960.624341:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 281 00000100:00100000:0.0:1787603960.624351:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2363:x1874438345744640:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603960.624358:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 120 00000100:00100000:3.0:1787603960.624364:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345744768:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603960.624431:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2363:x1874438345744640:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603960.624451:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 281 00000100:00100000:0.0:1787603960.624496:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 121 00000100:00100000:0.0:1787603960.624503:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2363:x1874438345744896:12345-192.168.202.21@tcp:400:kworker.0 00000100:00080000:2.0:1787603960.624826:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603960.627394:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345744768:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 3015us (3183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603960.627412:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 120 00000100:00100000:0.0:1787603960.627721:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2363:x1874438345744896:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 3215us (3431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603960.627730:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 121 00010000:00010000:1.0:1787603961.244065:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603962.263179:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787603962.329472:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787603962.839128:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787603962.839212:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355216640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603962.839304:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603962.842036:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355216896:0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.842146:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603962.842183:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787603962.842188:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355217024:0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.842208:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603962.842237:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355216896 00000100:00100000:2.0:1787603962.842244:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355216896 00000100:00100000:2.0:1787603962.842280:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355217024 00000100:00100000:2.0:1787603962.842283:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355217024 00000100:00100000:2.0:1787603962.842315:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787603962.842322:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355216896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.842366:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355216896:12345-0@lo:400:kworker.0 Request processed in 44us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603962.842373:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787603962.842388:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787603962.842394:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355217024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.842414:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355217024:12345-0@lo:400:kworker.0 Request processed in 21us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603962.842419:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1787603962.842435:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603962.842446:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355217152:0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.842467:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603962.842496:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787603962.842502:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355216768:0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.842525:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603962.842543:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355217280:0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.842565:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603962.842588:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355216768 00000100:00100000:2.0:1787603962.842592:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355216768 00000100:00100000:2.0:1787603962.842613:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787603962.842619:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355216768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.842645:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355216768:12345-0@lo:400:kworker.0 Request processed in 27us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603962.842651:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787603962.842673:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355217280 00000100:00100000:2.0:1787603962.842675:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355217280 00000100:00100000:2.0:1787603962.842699:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787603962.842705:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355217280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.842728:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355217280:12345-0@lo:400:kworker.0 Request processed in 23us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603962.842733:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787603962.842746:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787603962.842866:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355216768:0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.842881:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355217280:0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.842902:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355217152 00000100:00100000:2.0:1787603962.842905:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355217152 00000100:00100000:2.0:1787603962.842930:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787603962.842936:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355217152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.842979:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355217152:12345-0@lo:400:kworker.0 Request processed in 44us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603962.842986:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1787603962.843000:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603962.843018:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355217024:0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.843027:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355216896:0@lo:400:kworker.0 00000100:00100000:2.0:1787603962.843052:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355217152:0@lo:400:kworker.0 00000100:00100000:3.0:1787603962.843640:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355216640 00000100:00100000:3.0:1787603962.843646:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355216640 00000100:00100000:3.0:1787603962.843699:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787603962.843708:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355216640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787603962.843739:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603962.843785:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355216640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (4480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603962.843791:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787603962.843799:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2ba1a8000 x1874438355216640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787603962.843924:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355216640:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787603962.844084:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787603963.287305:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603963.351393:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787603963.351418:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355217408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787603963.351501:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603963.351573:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355217408 00000100:00100000:1.0:1787603963.351581:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355217408 00000100:00100000:1.0:1787603963.351631:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787603963.351642:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355217408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787603963.351676:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603963.351719:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355217408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603963.351725:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787603963.351772:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355217408:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787603964.316289:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787603964.403794:0:11832:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:39:22 (1787603962) 00010000:00010000:3.0:1787603965.337354:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603965.749868:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603965.749985:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603965.750028:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603965.752353:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345745280 00000100:00100000:3.0:1787603965.752368:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345745280 00000100:00100000:3.0:1787603965.752451:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345745152 00000100:00100000:3.0:1787603965.752455:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345745152 00000100:00100000:3.0:1787603965.752481:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 125 00000100:00100000:3.0:1787603965.752491:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2363:x1874438345745280:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603965.752605:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2363:x1874438345745280:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 115us (2619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603965.752614:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 125 00000100:00100000:3.0:1787603965.752633:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 126 00000100:00100000:3.0:1787603965.752640:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345745152:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603965.752668:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2363:x1874438345745152:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 29us (2639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603965.752674:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 126 00000100:00080000:2.0:1787603965.753568:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603965.760786:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345745024 00000100:00100000:1.0:1787603965.760830:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345745024 00000100:00100000:1.0:1787603965.761130:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 283 00000100:00100000:1.0:1787603965.761142:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2363:x1874438345745024:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603965.761230:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2363:x1874438345745024:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 90us (11372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603965.761238:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 283 00010000:00010000:1.0:1787603966.359195:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603967.383404:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603967.416714:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603967.416811:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345745408 00000100:00100000:3.0:1787603967.416823:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345745408 00000100:00100000:3.0:1787603967.416939:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 32 00000100:00100000:3.0:1787603967.416951:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:10234:x1874438345745408:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787603967.416972:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603967.417012:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901699 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a04 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.417101:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19016a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.417115:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19016a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.417128:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19016a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603967.417361:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787603967.417366:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787603967.417486:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19016a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787603967.417643:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787603967.417680:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901699 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a04 expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.417697:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19016a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a04 expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.417705:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35500) 00010000:00010000:3.0:1787603967.417708:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787603967.417711:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dadc00, rc 0) 00000100:00100000:3.0:1787603967.417831:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:10234:x1874438345745408:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 881us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603967.417883:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 32 00000100:00100000:0.0:1787603967.431482:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603967.433927:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345745536 00000100:00100000:3.0:1787603967.433946:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345745536 00000100:00100000:3.0:1787603967.434016:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 33 00000100:00100000:3.0:1787603967.434028:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:10235:x1874438345745536:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787603967.434050:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603967.434074:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19016a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a0b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.434260:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19016ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.434274:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19016ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.434304:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19016ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.434320:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a19016b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.434328:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a19016b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.434335:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a19016b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.434750:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad400/0xb5d1f3b1a19016bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.434760:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad400/0xb5d1f3b1a19016bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.434767:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad400/0xb5d1f3b1a19016bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603967.434910:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787603967.434915:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787603967.434992:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad400/0xb5d1f3b1a19016bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435004:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19016ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435010:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19016ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435027:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19016ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435033:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603967.435038:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19016ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435047:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19016ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435059:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35500) 00010000:00010000:3.0:1787603967.435063:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603967.435067:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19016ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435073:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19016ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435085:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a19016b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435091:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a19016b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435097:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a19016b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435102:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dacc00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603967.435105:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a19016b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435120:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a19016b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435127:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ed290d35300) 00010000:00010000:3.0:1787603967.435129:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603967.435132:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a19016b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435137:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a19016b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435170:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19016a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a0b expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435184:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad400/0xb5d1f3b1a19016bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a0b expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.435190:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:3.0:1787603967.435192:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787603967.435194:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad400, rc 0) 00000100:00100000:3.0:1787603967.435271:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:10235:x1874438345745536:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 1244us (3800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603967.435279:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 33 00000100:00100000:1.0:1787603967.438008:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603967.441734:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345745792 00000100:00100000:3.0:1787603967.441749:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345745792 00000100:00100000:3.0:1787603967.445059:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 34 00000100:00100000:3.0:1787603967.445129:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:10235:x1874438345745792:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787603967.445170:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603967.445193:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19016c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a12 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.445485:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19016ca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.445499:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19016ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.445510:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19016ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.445574:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19016d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.445582:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19016d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.445588:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19016d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.446156:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19016d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.446167:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19016d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603967.446175:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19016d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603967.446185:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787603967.452692:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19016ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452707:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19016ca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452719:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19016ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452725:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603967.452729:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19016ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452736:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19016ca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452753:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:1.0:1787603967.452757:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603967.452762:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19016ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452768:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19016ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452801:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19016d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452807:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19016d1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452812:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19016d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452817:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603967.452820:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19016d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452827:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19016d1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452876:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ed290d35900) 00010000:00010000:1.0:1787603967.452880:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603967.452883:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19016d1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.452890:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19016d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.453306:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19016c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a12 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.453323:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19016d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a12 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603967.453343:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed290d35200) 00010000:00010000:1.0:1787603967.453345:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603967.453348:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad800, rc 0) 00000100:00100000:1.0:1787603967.453426:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:10235:x1874438345745792:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 8345us (15427us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787603967.453435:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 34 00000100:00100000:2.0:1787603967.475314:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603967.475449:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345745920 00000100:00100000:1.0:1787603967.475461:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345745920 00000100:00100000:1.0:1787603967.475531:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 35 00000100:00100000:1.0:1787603967.475541:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:10235:x1874438345745920:12345-192.168.202.21@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787603967.475663:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:10235:x1874438345745920:12345-192.168.202.21@tcp:59:lhsmtool_posix.0 Request processed in 123us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603967.475671:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 35 00000100:00100000:3.0:1787603967.959080:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355217536:0@lo:400:kworker.0 00000100:00100000:2.0:1787603967.959106:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355217920:0@lo:400:kworker.0 00000100:00100000:3.0:1787603967.959208:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603967.959215:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603967.959368:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355217536 00000100:00100000:1.0:1787603967.959380:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355217536 00000100:00100000:1.0:1787603967.959439:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787603967.959450:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355217536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603967.964935:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355217792:0@lo:400:kworker.0 00000100:00100000:3.0:1787603967.965383:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355218048:0@lo:400:kworker.0 00000100:00100000:3.0:1787603967.965447:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603967.965873:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355217920 00000100:00100000:3.0:1787603967.965882:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355217920 00000100:00100000:3.0:1787603967.965947:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787603967.965956:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355217920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603967.966035:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355217920:12345-0@lo:400:kworker.0 Request processed in 80us (6830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603967.966044:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787603967.966096:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355218048 00000100:00100000:3.0:1787603967.966100:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355218048 00000100:00100000:3.0:1787603967.966131:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787603967.966138:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355218048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603967.966176:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355218048:12345-0@lo:400:kworker.0 Request processed in 39us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603967.966182:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787603967.966230:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355218048:0@lo:400:kworker.0 00000100:00080000:3.0:1787603967.966271:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787603967.966277:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603967.966306:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355217664:0@lo:400:kworker.0 00000100:00100000:3.0:1787603967.966338:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603967.966362:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355218176:0@lo:400:kworker.0 00000100:00100000:3.0:1787603967.966391:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603967.966410:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787603967.966433:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355218304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603967.966471:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603967.966499:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355217664 00000100:00100000:3.0:1787603967.967163:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355217664 00000100:00100000:3.0:1787603967.967206:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787603967.967214:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355217664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603967.967332:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355217664:12345-0@lo:400:kworker.0 Request processed in 118us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603967.967339:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787603967.967366:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355218304 00000100:00100000:3.0:1787603967.967371:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355218304 00000100:00100000:3.0:1787603967.967402:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787603967.967409:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355218304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787603967.967446:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603967.967492:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355218304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603967.967499:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1787603967.967891:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2ba1a9500 x1874438355218304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787603983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787603967.967913:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355218304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603967.967926:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355217664:0@lo:400:kworker.0 00000100:00100000:3.0:1787603967.967973:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355218176 00000100:00100000:3.0:1787603967.967978:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355218176 00000100:00100000:3.0:1787603967.968029:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787603967.968036:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355218176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603967.968078:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355218176:12345-0@lo:400:kworker.0 Request processed in 42us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603967.968111:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787603967.968128:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787603967.968148:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355218176:0@lo:400:kworker.0 00010000:00080000:2.0:1787603967.969090:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2ba1ddc00 x1874438355217920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787603983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787603967.969112:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355217920:0@lo:400:kworker.0 00000100:00100000:1.0:1787603967.969763:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355217536:12345-0@lo:400:kworker.0 Request processed in 10006us (10253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603967.969792:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787603967.969867:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355217536:0@lo:400:kworker.0 00000100:00100000:0.0:1787603967.971827:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603967.971909:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355217792 00000100:00100000:0.0:1787603967.971918:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355217792 00000100:00100000:0.0:1787603967.971990:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787603967.972001:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355217792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603967.972067:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355217792:12345-0@lo:400:kworker.0 Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603967.972075:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1787603967.973042:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603967.973095:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355217792:0@lo:400:kworker.0 00010000:00010000:3.0:1787603968.414247:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787603968.471481:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787603968.475435:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355218432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787603968.475503:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603968.477028:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355218432 00000100:00100000:0.0:1787603968.477044:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355218432 00000100:00100000:0.0:1787603968.477105:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787603968.477116:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355218432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787603968.477156:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603968.483140:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355218432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6014us (7624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603968.483155:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787603968.484198:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355218432:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787603969.431119:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603970.058884:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603970.059365:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345746048 00000100:00100000:0.0:1787603970.059381:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345746048 00000100:00100000:0.0:1787603970.059450:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 36 00000100:00100000:0.0:1787603970.059462:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:10278:x1874438345746048:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603970.059493:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603970.059515:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a19016e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a19 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059579:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a19016ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059604:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a19016ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059616:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a19016ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059630:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19016f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059636:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19016f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059642:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19016f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059896:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a19016ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059903:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a19016ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059907:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a19016ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059915:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603970.059918:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a19016ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059922:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a19016ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059931:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35500) 00010000:00010000:0.0:1787603970.059933:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603970.059936:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a19016ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059940:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a19016ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059948:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19016f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059951:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19016f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059954:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19016f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059957:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603970.059959:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19016f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059962:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19016f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059972:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ed28870b400) 00010000:00010000:0.0:1787603970.059974:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603970.059976:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19016f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.059979:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19016f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.060001:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a19016e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a19 expref: 10 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.060008:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35500) 00010000:00010000:0.0:1787603970.060009:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603970.060011:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a19016e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a19 expref: 10 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.060016:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594a00, rc 0) 00000100:00100000:0.0:1787603970.060063:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:10278:x1874438345746048:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 606us (1188us total) trans 0 rc 301/301 00000100:00100000:0.0:1787603970.060069:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 36 00000100:00080000:0.0:1787603970.060100:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603970.064389:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.064475:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345746304 00000100:00100000:3.0:1787603970.064497:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345746304 00000100:00100000:3.0:1787603970.064559:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 37 00000100:00100000:3.0:1787603970.064570:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:10278:x1874438345746304:12345-192.168.202.21@tcp:36:lfs.0 00010000:00010000:3.0:1787603970.064636:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603970.064663:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19016a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a04 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.064681:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35500) 00010000:00010000:3.0:1787603970.064691:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787603970.065012:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19016fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.065026:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19016fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.065036:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19016fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.065048:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901702 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.065055:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901702 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.065069:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901702 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603970.066062:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787603970.066076:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19016fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.066086:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19016fb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.066093:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19016fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.066099:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603970.066104:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19016fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.066112:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19016fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.066126:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:3.0:1787603970.066129:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603970.066133:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19016fb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.066139:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19016fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787603970.066156:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da3d5854 reply state 0000000097fc7bee transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901702 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603970.066177:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787603970.066294:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:10278:x1874438345746304:12345-192.168.202.21@tcp:36:lfs.0 Request processed in 1724us (1914us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787603970.066303:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 37 00010000:00010000:2.0:1787603970.068155:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901702 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.068173:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901702 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.068179:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901702 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.068185:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dacc00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603970.068190:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901702 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.068197:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901702 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.068213:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ed290d35e00) 00010000:00010000:2.0:1787603970.068217:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603970.068221:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901702 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.068227:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a1901702 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603970.225644:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.225686:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345746432 00000100:00100000:3.0:1787603970.225698:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345746432 00000100:00100000:3.0:1787603970.225775:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 38 00000100:00100000:3.0:1787603970.225786:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:10286:x1874438345746432:12345-192.168.202.21@tcp:101:lctl.0 00010000:00010000:3.0:1787603970.225811:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603970.225855:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a20 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.225924:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a1901710 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.225939:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a1901710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.225949:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a1901710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603970.226011:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787603970.226015:0:7875:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787603970.226057:0:7875:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a1901710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.226083:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a20 expref: 11 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.226120:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a1901710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a20 expref: 10 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.226129:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:3.0:1787603970.226132:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787603970.226134:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad600, rc 0) 00000100:00100000:3.0:1787603970.226190:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:10286:x1874438345746432:12345-192.168.202.21@tcp:101:lctl.0 Request processed in 406us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603970.226197:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 38 00000100:00100000:0.0:1787603970.338085:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.338364:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345746560 00000100:00100000:3.0:1787603970.338375:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345746560 00000100:00100000:3.0:1787603970.338436:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 39 00000100:00100000:3.0:1787603970.338446:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:10292:x1874438345746560:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:3.0:1787603970.338469:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603970.338503:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901717 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a27 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338568:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190171e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338580:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190171e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338590:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190171e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338603:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901725 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338622:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338628:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338774:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a190172c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338783:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a190172c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338790:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a190172c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603970.338822:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787603970.338826:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787603970.338891:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a190172c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338903:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190171e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338909:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190171e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338915:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190171e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338921:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dadc00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603970.338924:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190171e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338937:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190171e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338949:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:3.0:1787603970.338952:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603970.338956:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190171e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338962:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190171e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338973:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338979:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901725 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338984:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901725 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338990:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603970.338992:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901725 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.338998:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901725 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.339005:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ed290d35500) 00010000:00010000:3.0:1787603970.339007:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603970.339010:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901725 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.339025:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901725 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.339058:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901717 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a27 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.339071:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a190172c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a27 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.339079:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:3.0:1787603970.339082:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787603970.339084:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dacc00, rc 0) 00000100:00100000:3.0:1787603970.339154:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:10292:x1874438345746560:12345-192.168.202.21@tcp:101:bash.0 Request processed in 709us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603970.339161:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 39 00000100:00100000:3.0:1787603970.348942:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603970.349028:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345746816 00000100:00100000:0.0:1787603970.349039:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345746816 00000100:00100000:0.0:1787603970.349107:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 40 00000100:00100000:0.0:1787603970.349118:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:10292:x1874438345746816:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:0.0:1787603970.349143:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603970.349182:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901733 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a2e expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.349324:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190173a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.349338:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190173a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.349349:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190173a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.349364:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901741 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.349371:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.349377:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787603970.350001:0:7875:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787603970.350180:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901748 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.350190:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.350197:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.350231:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190173a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.350247:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190173a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.350253:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190173a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.350258:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603970.350262:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190173a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.350269:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190173a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.350281:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:0.0:1787603970.350284:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603970.350288:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190173a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.350293:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190173a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787603970.350306:0:7875:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8d8b20a reply state 000000002ee4c5a3 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603970.350315:0:7875:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787603970.350345:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901733 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a2e expref: 14 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.350360:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a2e expref: 13 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.350379:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870bc00) 00010000:00010000:0.0:1787603970.350381:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787603970.350384:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594400, rc 0) 00000100:00100000:0.0:1787603970.351258:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:10292:x1874438345746816:12345-192.168.202.21@tcp:101:bash.0 Request processed in 2135us (2320us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787603970.351269:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 40 00010000:00010000:0.0:1787603970.359347:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.359365:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901741 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.359372:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901741 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.359379:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603970.359384:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901741 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.359390:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901741 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.359407:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed28870b400) 00010000:00010000:0.0:1787603970.359410:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603970.359415:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901741 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.359421:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901741 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603970.365329:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603970.365766:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345746944 00000100:00100000:1.0:1787603970.365779:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345746944 00000100:00100000:1.0:1787603970.365826:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00100000:1.0:1787603970.366116:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874438345746944:12345-192.168.202.21@tcp:8:bash.0 00010000:00080000:1.0:1787603970.366153:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:1.0:1787603970.366183:0:6679:0:(genops.c:1385:class_connect()) connect: client a45d6158-dc8e-48e6-b534-483bf3fa20ad, cookie 0xb5d1f3b1a1901756 00002000:00100000:1.0:1787603970.366193:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a45d6158-dc8e-48e6-b534-483bf3fa20ad/ffff9ed2863f2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787603970.366214:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:1.0:1787603970.366436:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787603970.366461:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9ed2863f3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787603970.366552:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2362:x1874438345746944:12345-192.168.202.21@tcp:8:bash.0 Request processed in 715us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603970.366558:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00100000:2.0:1787603970.370251:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.370314:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345747072 00000100:00100000:3.0:1787603970.370322:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345747072 00000100:00100000:3.0:1787603970.370377:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 21 00000100:00100000:3.0:1787603970.370384:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:0:x1874438345747072:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:3.0:1787603970.370399:0:10671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603970.370416:0:10671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190175d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a35 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787603970.370438:0:10671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787603970.370466:0:10671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=303s v=(0 0) 00010000:00010000:3.0:1787603970.370470:0:10671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787603970.370486:0:10671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190175d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a35 expref: 7 pid: 10671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.370508:0:10671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190175d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a35 expref: 7 pid: 10671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.370521:0:10671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad200, rc 0) 00000100:00100000:3.0:1787603970.370578:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:0:x1874438345747072:12345-192.168.202.21@tcp:101:bash.0 Request processed in 194us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603970.370583:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 21 00000100:00080000:0.0:1787603970.370636:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603970.379227:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603970.379337:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345747200 00000100:00100000:1.0:1787603970.379347:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345747200 00000100:00100000:1.0:1787603970.379404:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 22 00000100:00100000:1.0:1787603970.379414:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:10292:x1874438345747200:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:1.0:1787603970.379437:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603970.379459:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a3c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.379504:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190175d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a35 expref: 8 pid: 10671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.379514:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603970.379519:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603970.379539:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.379588:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190175d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a35 expref: 8 pid: 10671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.379602:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190175d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a35 expref: 8 pid: 10671 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603970.379617:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874438355218560:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787603970.379774:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787603970.391947:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.392041:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345747328 00000100:00100000:3.0:1787603970.392050:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345747328 00010000:00010000:3.0:1787603970.392097:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190175d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a35 expref: 9 pid: 10671 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603970.392143:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 35 00000100:00100000:3.0:1787603970.392154:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2363:x1874438345747328:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787603970.392167:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603970.392192:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190175d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a35 expref: 9 pid: 10671 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.392207:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190175d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a35 expref: 9 pid: 10671 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.392253:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787603970.392258:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787603970.392266:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.392275:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.392313:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603970.392328:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1874438355218688:192.168.202.21@tcp:105: 00000100:00100000:3.0:1787603970.392412:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa69fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787603970.395207:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5806:1874438355218688:192.168.202.21@tcp:105: 00010000:00010000:3.0:1787603970.395234:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603970.395297:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2363:x1874438345747328:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 3144us (3361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603970.395308:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 35 00010000:00010000:1.0:1787603970.396110:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190175d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a35 expref: 8 pid: 10671 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603970.396132:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874438355218560:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603970.396156:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.396170:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e400, rc 0) 00000100:00100000:1.0:1787603970.396221:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:10292:x1874438345747200:12345-192.168.202.21@tcp:101:bash.0 Request processed in 16808us (17004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603970.396229:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 22 00000100:00100000:2.0:1787603970.410531:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603970.410684:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345747584 00000100:00100000:0.0:1787603970.410695:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345747584 00000100:00100000:0.0:1787603970.410770:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:0.0:1787603970.410781:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:10292:x1874438345747584:12345-192.168.202.21@tcp:35:bash.0 00000100:00100000:0.0:1787603970.411179:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:10292:x1874438345747584:12345-192.168.202.21@tcp:35:bash.0 Request processed in 399us (658us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787603970.411188:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6 00010000:00010000:1.0:1787603970.455710:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603970.588566:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.589112:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345747840 00000100:00100000:3.0:1787603970.589123:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345747840 00000100:00100000:3.0:1787603970.589190:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 41 00000100:00100000:3.0:1787603970.589201:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:10302:x1874438345747840:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787603970.589224:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603970.589247:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a190176b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a43 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603970.589528:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787603970.589767:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a190176b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a43 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.589783:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:3.0:1787603970.589786:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787603970.589792:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a190176b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a43 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.589805:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad000, rc 0) 00000100:00100000:3.0:1787603970.589892:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:10302:x1874438345747840:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 692us (1335us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1787603970.589900:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 41 00000100:00100000:3.0:1787603970.594287:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603970.594390:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345748096 00000100:00100000:2.0:1787603970.594401:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345748096 00000100:00100000:2.0:1787603970.594466:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:2.0:1787603970.594492:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:10302:x1874438345748096:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:2.0:1787603970.594994:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:10302:x1874438345748096:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 502us (715us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787603970.595003:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 7 00000001:00080000:0.0:1787603970.670009:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000100:00100000:2.0:1787603970.682775:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.682870:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345748224 00000100:00100000:3.0:1787603970.682882:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345748224 00000100:00100000:3.0:1787603970.682947:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 42 00000100:00100000:3.0:1787603970.682958:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+12:10308:x1874438345748224:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787603970.682981:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603970.683001:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901779 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a4a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.683096:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901780 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.683108:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.683125:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603970.683293:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787603970.683297:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787603970.683360:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.683384:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901779 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a4a expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.683399:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a4a expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.683407:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:3.0:1787603970.683410:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787603970.683413:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad000, rc 0) 00000100:00100000:3.0:1787603970.683476:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:10308:x1874438345748224:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 520us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603970.683484:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 42 00000100:00100000:3.0:1787603970.689799:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603970.689994:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345748480 00000100:00100000:1.0:1787603970.690008:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345748480 00000100:00100000:1.0:1787603970.690179:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 43 00000100:00100000:1.0:1787603970.690197:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:10308:x1874438345748480:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787603970.690219:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603970.690239:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901787 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a51 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.690339:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190178e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.690353:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190178e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.690362:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190178e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603970.690374:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787603970.690505:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901787 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a51 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.690523:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190178e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a51 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.690532:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870bc00) 00010000:00010000:1.0:1787603970.690536:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787603970.690539:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7ec00, rc 0) 00000100:00100000:1.0:1787603970.690617:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:10308:x1874438345748480:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 421us (828us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787603970.690625:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 43 00000100:00100000:1.0:1787603970.693945:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.694019:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345748736 00000100:00100000:3.0:1787603970.694030:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345748736 00000100:00100000:3.0:1787603970.694078:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 44 00000100:00100000:3.0:1787603970.694086:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:10308:x1874438345748736:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787603970.694107:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603970.694123:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190179c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a58 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.694247:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19017a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.694260:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19017a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.694270:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19017a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603970.694282:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787603970.694408:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190179c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a58 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.694428:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19017a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a58 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.694436:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870bc00) 00010000:00010000:3.0:1787603970.694440:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787603970.694443:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac000, rc 0) 00000100:00100000:3.0:1787603970.694510:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:10308:x1874438345748736:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 425us (574us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787603970.694518:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 44 00000100:00100000:3.0:1787603970.699386:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603970.699605:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345748864 00000100:00100000:2.0:1787603970.699615:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345748864 00000100:00100000:2.0:1787603970.699692:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 2 00000100:00100000:2.0:1787603970.699703:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:2363:x1874438345748864:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603970.699722:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603970.699761:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190178e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a51 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.699783:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870bc00) 00010000:00010000:2.0:1787603970.699789:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603970.699896:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:2363:x1874438345748864:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 195us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603970.699905:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 2 00000100:00100000:2.0:1787603970.705041:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.705129:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345748992 00000100:00100000:3.0:1787603970.705141:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345748992 00000100:00100000:3.0:1787603970.705200:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 23 00000100:00100000:3.0:1787603970.705211:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2364:x1874438345748992:12345-192.168.202.21@tcp:1:lfs.0 00010000:00010000:3.0:1787603970.705272:0:10671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.705293:0:10671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.705302:0:10671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787603970.705306:0:10671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787603970.705310:0:10671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.705343:0:10671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.705356:0:10671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 7 pid: 6678 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603970.705368:0:10671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10671:1874438355218816:192.168.202.21@tcp:104: 00000100:00100000:3.0:1787603970.705456:0:10671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa69fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787603970.708471:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603970.708809:0:10671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10671:1874438355218816:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787603970.708877:0:10671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603970.709182:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345749120 00000100:00100000:1.0:1787603970.709203:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345749120 00002000:00100000:1.0:1787603970.709251:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9ed285d1a300 x1874438345749120/t0(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:296/0 lens 504/0 e 0 to 0 dl 1787603981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787603970.709261:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed285d1a300 with x1874438345749120 ext(0->12) 00010000:00010000:1.0:1787603970.709269:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 8 pid: 6678 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.709283:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 8 pid: 6678 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787603970.709290:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed285d1a300 00000100:00100000:1.0:1787603970.709328:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:1.0:1787603970.709338:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2364:x1874438345749120:12345-192.168.202.21@tcp:4:lfs.0 00000001:00100000:1.0:1787603970.737146:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000100:00100000:0.0:1787603970.737745:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2364:x1874438345749120:12345-192.168.202.21@tcp:4:lfs.0 Request processed in 28401us (29276us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787603970.737772:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 0 00002000:00100000:0.0:1787603970.737786:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9ed285d1a300 x1874438345749120/t4294967299(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:296/0 lens 504/448 e 0 to 0 dl 1787603981 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787603970.737798:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed285d1a300 with x1874438345749120 ext(0->12) 00010000:00010000:0.0:1787603970.737809:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 9 pid: 6678 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.737828:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 9 pid: 6678 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787603970.737866:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed285d1a300 00000100:00100000:2.0:1787603970.741893:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603970.741970:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345749248 00000100:00100000:0.0:1787603970.741978:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345749248 00010000:00010000:0.0:1787603970.742032:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 9 pid: 6678 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603970.742107:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 36 00000100:00100000:0.0:1787603970.742116:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2366:x1874438345749248:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787603970.742130:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787603970.742148:0:5807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787603970.742150:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787603970 00002000:00010000:0.0:1787603970.742152:0:5807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787603970 00002000:00010000:0.0:1787603970.742154:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787603970 00010000:00010000:0.0:1787603970.742161:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 9 pid: 6678 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.742173:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 9 pid: 6678 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.742195:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a99b0287/0xb5d1f3b1a1901764 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a3c expref: 9 pid: 6678 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.742210:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787603970.742214:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787603970.742219:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.742228:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.742267:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603970.742323:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2366:x1874438345749248:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 208us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603970.742330:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 36 00010000:00010000:2.0:1787603970.742380:0:10671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.742394:0:10671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.742419:0:10671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.742426:0:10671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.742433:0:10671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.742439:0:10671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dadc00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787603970.742443:0:10671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.742450:0:10671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.742462:0:10671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.742468:0:10671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005519c883/0xb5d1f3b1a19017b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603970.742531:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2364:x1874438345748992:12345-192.168.202.21@tcp:1:lfs.0 Request processed in 37322us (37501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603970.742537:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 23 00000100:00100000:2.0:1787603970.746168:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.746349:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345749504 00000100:00100000:3.0:1787603970.746359:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345749504 00000100:00100000:3.0:1787603970.746450:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:3.0:1787603970.746462:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:10308:x1874438345749504:12345-192.168.202.21@tcp:35:lfs.0 00000004:00010000:3.0:1787603970.746535:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19017a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a58 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787603970.746905:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1787603970.746966:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1787603970.748334:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1787603970.748416:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.748435:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901748 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a2e expref: 20 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.748444:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.748554:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a2e expref: 20 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.748573:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901748 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a2e expref: 20 pid: 7875 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603970.748666:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d18a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1874438355218944:192.168.202.21@tcp:104: 00000100:00100000:3.0:1787603970.748828:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa69f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787603970.753175:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603970.753484:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345749632 00000100:00100000:2.0:1787603970.753495:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345749632 00010000:00010000:2.0:1787603970.753536:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901748 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a2e expref: 21 pid: 7875 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603970.753577:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 37 00000100:00100000:2.0:1787603970.753586:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:2363:x1874438345749632:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603970.753600:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603970.753606:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901748 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a2e expref: 21 pid: 7875 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.753618:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901748 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a2e expref: 21 pid: 7875 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.753638:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870bc00) 00010000:00010000:2.0:1787603970.753643:0:6693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.753651:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.753657:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.753686:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603970.753733:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:2363:x1874438345749632:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 148us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603970.753740:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 37 00010000:00010000:3.0:1787603970.755233:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901748 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a2e expref: 20 pid: 7875 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603970.755255:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d18a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1874438355218944:192.168.202.21@tcp:104: 00010000:00010000:3.0:1787603970.755277:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.755305:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.755310:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787603970.755444:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787603970.755652:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787603970.755777:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d18a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1874438355219072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787603970.756489:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603970.756522:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa69f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787603970.756619:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355219072 00000100:00100000:2.0:1787603970.756626:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355219072 00000100:00100000:2.0:1787603970.756686:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787603970.756694:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1874438355219072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787603970.756779:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1874438355219072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603970.756786:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787603970.756879:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603970.757068:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d18a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1874438355219072:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787603970.759106:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787603970.759217:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d18a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1874438355219200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787603970.759280:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603970.759390:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa69f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603970.762668:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355219200 00000100:00100000:2.0:1787603970.762685:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355219200 00000100:00100000:2.0:1787603970.762805:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787603970.762817:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1874438355219200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787603970.763131:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5825:x1874438355219200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 315us (3849us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787603970.763139:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787603970.763238:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d18a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1874438355219200:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787603970.763310:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787603970.763361:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.763371:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.763379:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.763385:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603970.763390:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.763410:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.763425:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870bc00) 00010000:00010000:1.0:1787603970.763427:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787603970.763432:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.763437:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787603970.763632:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787603970.763894:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787603970.763905:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 303828066684ns, next at 304828064879ns, rc = 0 00000001:00080000:1.0:1787603970.763912:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787603970.763945:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870bc00) 00010000:00010000:1.0:1787603970.763947:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787603970.763954:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19017a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a58 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603970.764050:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:10308:x1874438345749504:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 17590us (17891us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787603970.764056:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 8 00000020:00080000:1.0:1787603970.764061:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787603970.767086:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603970.767183:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345749760 00000100:00100000:1.0:1787603970.767195:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345749760 00000100:00100000:1.0:1787603970.767257:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 45 00000100:00100000:1.0:1787603970.767267:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:10308:x1874438345749760:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787603970.767306:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603970.767333:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a19017bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a5f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.767393:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a19017bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a5f expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.767407:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a19017bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a5f expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603970.767425:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:1.0:1787603970.767428:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787603970.767432:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e600, rc 0) 00000100:00100000:1.0:1787603970.767629:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:10308:x1874438345749760:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 362us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603970.767635:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 45 00000100:00100000:1.0:1787603970.773915:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603970.773994:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345750016 00000100:00100000:2.0:1787603970.774003:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345750016 00000100:00100000:2.0:1787603970.774057:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:2.0:1787603970.774066:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed291f94c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:10308:x1874438345750016:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:2.0:1787603970.774295:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed291f94c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+25:10308:x1874438345750016:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 229us (387us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787603970.774303:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:0.0:1787603970.862495:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603970.862538:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.862705:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345750272 00000100:00100000:3.0:1787603970.862715:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345750272 00000100:00100000:3.0:1787603970.862809:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 130 00000100:00100000:3.0:1787603970.862820:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345750272:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603970.862925:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345750272:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 107us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603970.862932:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 130 00000100:00080000:0.0:1787603970.863391:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603970.863695:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345750144 00000100:00100000:1.0:1787603970.863702:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345750144 00000100:00100000:1.0:1787603970.864188:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 285 00000100:00100000:1.0:1787603970.864199:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345750144:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603970.864262:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345750144:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 67us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603970.864270:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 285 00000100:00100000:0.0:1787603970.878805:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.878915:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345750528 00000100:00100000:3.0:1787603970.878925:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345750528 00000100:00100000:3.0:1787603970.878982:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 46 00000100:00100000:3.0:1787603970.879006:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+25:10318:x1874438345750528:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787603970.879028:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603970.879045:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19017c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a66 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603970.879278:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787603970.879434:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19017c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a66 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.879449:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:3.0:1787603970.879452:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787603970.879456:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19017c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a66 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.879467:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac000, rc 0) 00000100:00100000:3.0:1787603970.879535:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:10318:x1874438345750528:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 531us (741us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787603970.879541:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 46 00000100:00100000:3.0:1787603970.883026:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603970.883141:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345750656 00000100:00100000:0.0:1787603970.883151:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345750656 00000100:00100000:0.0:1787603970.883220:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 47 00000100:00100000:0.0:1787603970.883231:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:10318:x1874438345750656:12345-192.168.202.21@tcp:34:lfs.0 00010000:00010000:0.0:1787603970.883309:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19017d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.883325:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19017d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.883336:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19017d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.883350:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19017db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.883356:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19017db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.883376:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19017db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.883780:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19017e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.883790:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19017e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.883798:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19017e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787603970.884062:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19017e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884077:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19017d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884083:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19017d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884447:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19017d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884453:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603970.884458:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19017d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884466:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19017d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884488:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:0.0:1787603970.884500:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603970.884506:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19017d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884513:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19017d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884528:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19017db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884535:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19017db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884540:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19017db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884545:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595c00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603970.884548:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19017db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884554:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19017db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884562:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed28870b100) 00010000:00010000:0.0:1787603970.884565:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603970.884568:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19017db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884574:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19017db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884714:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19017e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884727:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19017e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884733:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19017e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884738:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603970.884742:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19017e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884758:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19017e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884767:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:0.0:1787603970.884769:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603970.884772:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19017e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603970.884779:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19017e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603970.886098:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:10318:x1874438345750656:12345-192.168.202.21@tcp:34:lfs.0 Request processed in 2845us (3059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603970.886112:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 47 00000100:00100000:0.0:1787603970.889928:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603970.890032:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345750912 00000100:00100000:2.0:1787603970.890043:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345750912 00000100:00100000:2.0:1787603970.890145:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:2.0:1787603970.890157:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:10318:x1874438345750912:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:2.0:1787603970.890924:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+27:10318:x1874438345750912:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 765us (1089us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787603970.890933:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:0.0:1787603970.977394:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603970.977507:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345751168 00000100:00100000:3.0:1787603970.977519:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345751168 00000100:00100000:3.0:1787603970.977583:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 48 00000100:00100000:3.0:1787603970.977605:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+27:10321:x1874438345751168:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787603970.977632:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603970.977655:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19017e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a6d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.977763:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19017f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.977777:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19017f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.977790:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19017f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.977805:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.977812:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.977819:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978174:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19017fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978183:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19017fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978190:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19017fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603970.978200:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787603970.978290:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19017f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978297:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19017f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978310:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19017f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978315:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603970.978320:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19017f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978327:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19017f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978339:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:3.0:1787603970.978342:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603970.978346:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19017f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978351:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19017f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978364:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978369:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978374:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978378:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603970.978381:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978394:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978402:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed290d35e00) 00010000:00010000:3.0:1787603970.978404:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603970.978406:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978411:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19017f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978453:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19017e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a6d expref: 30 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978466:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19017fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a6d expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603970.978473:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603970.978475:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787603970.978477:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dadc00, rc 0) 00000100:00100000:3.0:1787603970.978531:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:10321:x1874438345751168:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 929us (1147us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1787603970.978539:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 48 00000100:00100000:3.0:1787603970.988447:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603970.988572:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345751296 00000100:00100000:2.0:1787603970.988583:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345751296 00000100:00100000:2.0:1787603970.988651:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 49 00000100:00100000:2.0:1787603970.988662:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:10321:x1874438345751296:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:2.0:1787603970.988728:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a190180c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.988752:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a190180c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.988764:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a190180c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.988790:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a190180c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.988797:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a190180c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.988804:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a190180c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.988810:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603970.988829:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a190180c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.988889:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a190180c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.988903:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:2.0:1787603970.988906:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787603970.988911:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a190180c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603970.988918:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a190180c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603970.992857:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:10321:x1874438345751296:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 4167us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603970.992872:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 49 00000100:00100000:3.0:1787603970.996025:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603970.996128:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345751552 00000100:00100000:1.0:1787603970.996138:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345751552 00000100:00100000:1.0:1787603970.996199:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:1.0:1787603970.996227:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:10321:x1874438345751552:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:1.0:1787603970.996495:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+30:10321:x1874438345751552:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 270us (480us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787603970.996503:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 11 00010000:00010000:3.0:1787603971.479915:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603971.537870:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603971.538059:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345751808 00000100:00100000:3.0:1787603971.538070:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345751808 00000100:00100000:3.0:1787603971.538149:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 50 00000100:00100000:3.0:1787603971.538160:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+30:10352:x1874438345751808:12345-192.168.202.21@tcp:101:cat.0 00010000:00010000:3.0:1787603971.538182:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603971.538201:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901813 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a74 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.538302:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190181a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.538317:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190181a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.538328:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190181a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603971.538339:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787603971.538498:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901813 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a74 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.538520:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190181a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a74 expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.538529:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603971.538532:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787603971.538536:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac800, rc 0) 00000100:00100000:3.0:1787603971.538881:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:10352:x1874438345751808:12345-192.168.202.21@tcp:101:cat.0 Request processed in 720us (1055us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787603971.538889:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 50 00000100:00100000:3.0:1787603971.551633:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603971.552065:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345752064 00000100:00100000:2.0:1787603971.552076:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345752064 00000100:00100000:2.0:1787603971.552144:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:2.0:1787603971.552154:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:10352:x1874438345752064:12345-192.168.202.21@tcp:35:cat.0 00000100:00100000:2.0:1787603971.552402:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+33:10352:x1874438345752064:12345-192.168.202.21@tcp:35:cat.0 Request processed in 249us (779us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787603971.552410:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:0.0:1787603971.558704:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603971.558953:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345752192 00000100:00100000:3.0:1787603971.558972:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345752192 00000100:00100000:3.0:1787603971.559032:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3 00000100:00100000:3.0:1787603971.559041:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa48dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+33:2364:x1874438345752192:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787603971.559054:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603971.559074:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190181a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a74 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.559092:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603971.559097:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603971.559157:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa48dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:2364:x1874438345752192:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 116us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603971.559163:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3 00000100:00100000:0.0:1787603971.697264:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603971.697362:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345752448 00000100:00100000:3.0:1787603971.697372:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345752448 00000100:00100000:3.0:1787603971.697433:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 51 00000100:00100000:3.0:1787603971.697444:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:10358:x1874438345752448:12345-192.168.202.21@tcp:101:dd.0 00010000:00010000:3.0:1787603971.697469:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603971.697472:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787603971.697508:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901780 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a4a expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.697528:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:3.0:1787603971.697533:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787603971.697546:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901828 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a7b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.697655:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.697667:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19017fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a6d expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.697675:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.697707:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19017fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a6d expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.697721:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19017fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a6d expref: 32 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603971.697734:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d1bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355219328:192.168.202.21@tcp:104: 00000100:00100000:3.0:1787603971.697902:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa69fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787603971.702219:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d1bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355219328:192.168.202.21@tcp:104: 00010000:00010000:3.0:1787603971.702250:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603971.709954:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603971.710037:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345752576 00000100:00100000:2.0:1787603971.710046:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345752576 00010000:00010000:2.0:1787603971.710086:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19017fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a6d expref: 33 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603971.710126:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 38 00000100:00100000:2.0:1787603971.710151:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+33:2364:x1874438345752576:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603971.710167:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603971.710174:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19017fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a6d expref: 33 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.710187:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19017fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a6d expref: 33 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.710208:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19017fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a6d expref: 33 pid: 5823 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.710225:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:2.0:1787603971.710230:0:6693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.710239:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.710246:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.710281:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603971.710343:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:2364:x1874438345752576:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 193us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603971.710351:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 38 00010000:00010000:3.0:1787603971.710584:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.710593:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603971.710611:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787603971.710828:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901828 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a7b expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.710875:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a7b expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.710884:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603971.710887:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787603971.710889:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac000, rc 0) 00000100:00100000:3.0:1787603971.710930:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:10358:x1874438345752448:12345-192.168.202.21@tcp:101:dd.0 Request processed in 13488us (13677us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787603971.710937:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 51 00000100:00100000:0.0:1787603971.713136:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603971.713233:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345752832 00000100:00100000:1.0:1787603971.713242:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345752832 00000100:00100000:1.0:1787603971.713295:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 52 00000100:00100000:1.0:1787603971.713305:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:10358:x1874438345752832:12345-192.168.202.21@tcp:36:dd.0 00010000:00010000:1.0:1787603971.713542:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190183d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603971.713557:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190183d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603971.713569:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190183d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787603971.713616:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787603971.713637:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6c78c02 reply state 00000000dd3e0406 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190183d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603971.713645:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787603971.713728:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+35:10358:x1874438345752832:12345-192.168.202.21@tcp:36:dd.0 Request processed in 425us (599us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787603971.713736:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 52 00000020:00080000:1.0:1787603971.713752:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787603971.715352:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190183d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.715368:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190183d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.715385:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190183d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.715390:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603971.715394:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190183d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.715401:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190183d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.715416:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:2.0:1787603971.715419:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603971.715423:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190183d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.715428:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190183d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603971.959162:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603971.959259:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345752960 00000100:00100000:2.0:1787603971.959269:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345752960 00000100:00100000:2.0:1787603971.959322:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 53 00000100:00100000:2.0:1787603971.959331:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+34:10372:x1874438345752960:12345-192.168.202.21@tcp:101:stat.0 00010000:00010000:2.0:1787603971.959355:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603971.959374:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901844 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a82 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.959432:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a190184b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.959444:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a190184b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.959469:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a190184b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.959497:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901852 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.959503:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.959508:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.959806:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.959817:0:7875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a7b expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.959824:0:7875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901859 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.959880:0:7875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a7b expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.959892:0:7875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a7b expref: 35 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603971.959905:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355219456:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787603971.959991:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9cfe300 going to sleep for 11 seconds 00000100:00100000:2.0:1787603971.963233:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355219456:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787603971.963265:0:7875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603971.967931:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603971.968110:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345753216 00000100:00100000:2.0:1787603971.968120:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345753216 00000100:00100000:2.0:1787603971.968181:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:2.0:1787603971.968191:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+36:5605:x1874438345753216:12345-192.168.202.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787603971.968536:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:5605:x1874438345753216:12345-192.168.202.21@tcp:35:ldlm_bl.0 Request processed in 346us (614us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787603971.968543:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:1.0:1787603971.970628:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603971.970706:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345753344 00000100:00100000:3.0:1787603971.970715:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345753344 00010000:00010000:3.0:1787603971.970768:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a7b expref: 37 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603971.970811:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 39 00000100:00100000:3.0:1787603971.970821:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:2364:x1874438345753344:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787603971.970834:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603971.970872:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a7b expref: 37 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.970887:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a7b expref: 37 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.970909:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a190182f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a7b expref: 37 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.970944:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603971.970950:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.970971:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.970979:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901859 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603971.971010:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603971.971069:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+36:2364:x1874438345753344:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 248us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603971.971076:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 39 00010000:00010000:2.0:1787603971.971477:0:7875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971487:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787603971.971528:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787603971.971532:0:7875:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787603971.971570:0:7875:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971582:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971591:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a190184b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971597:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a190184b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971615:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a190184b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971620:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603971.971624:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a190184b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971631:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a190184b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971641:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:2.0:1787603971.971643:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603971.971647:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a190184b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971652:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a190184b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971662:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971668:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901852 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971673:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971679:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603971.971682:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971696:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901852 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971704:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed2b2e8ba00) 00010000:00010000:2.0:1787603971.971706:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603971.971708:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901852 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971714:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901852 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971919:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901844 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a82 expref: 36 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971935:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a82 expref: 35 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603971.971942:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:2.0:1787603971.971944:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787603971.971947:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962600, rc 0) 00000100:00100000:2.0:1787603971.972264:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+35:10372:x1874438345752960:12345-192.168.202.21@tcp:101:stat.0 Request processed in 12933us (13110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603971.972272:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 53 00000100:00100000:1.0:1787603972.030270:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603972.030394:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345753600 00000100:00100000:2.0:1787603972.030405:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345753600 00000100:00100000:2.0:1787603972.030494:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 54 00000100:00100000:2.0:1787603972.030507:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+35:10378:x1874438345753600:12345-192.168.202.21@tcp:36:truncate.0 00010000:00010000:2.0:1787603972.030574:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603972.030601:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901859 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a82 expref: 35 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.030622:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:2.0:1787603972.030628:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787603972.031406:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901860 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.031424:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.031433:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787603972.031500:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787603972.031521:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065a352a0 reply state 000000000ea0bf95 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603972.031529:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787603972.031641:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:10378:x1874438345753600:12345-192.168.202.21@tcp:36:truncate.0 Request processed in 1136us (1379us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787603972.031648:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 54 00000020:00080000:2.0:1787603972.031653:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1787603972.031793:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787603972.036865:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.036883:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901860 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.036890:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901860 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.036895:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603972.036900:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901860 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.036906:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901860 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.036944:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603972.036947:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603972.036950:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901860 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.036964:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901860 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603972.175115:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603972.175219:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345753728 00000100:00100000:3.0:1787603972.175230:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345753728 00000100:00100000:3.0:1787603972.175296:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 55 00000100:00100000:3.0:1787603972.175306:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+36:10392:x1874438345753728:12345-192.168.202.21@tcp:101:stat.0 00010000:00010000:3.0:1787603972.175340:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603972.175362:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901867 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175449:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190186e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175476:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190186e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175487:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190186e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175503:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175512:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175531:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175870:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175879:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175887:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603972.175922:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787603972.175926:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787603972.175947:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175958:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175966:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190186e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175973:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190186e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175980:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190186e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.175985:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603972.175990:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190186e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176004:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190186e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176018:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:3.0:1787603972.176021:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603972.176039:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190186e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176045:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190186e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176057:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176062:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901875 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176067:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176071:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603972.176074:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176080:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901875 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176087:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed290d35e00) 00010000:00010000:3.0:1787603972.176089:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603972.176092:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901875 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176106:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901875 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176139:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901867 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a89 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176150:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a89 expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.176157:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603972.176159:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787603972.176161:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac200, rc 0) 00000100:00100000:3.0:1787603972.176226:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:10392:x1874438345753728:12345-192.168.202.21@tcp:101:stat.0 Request processed in 922us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603972.176233:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 55 00000100:00100000:0.0:1787603972.279432:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603972.279720:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345753984 00000100:00100000:3.0:1787603972.279731:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345753984 00000100:00100000:3.0:1787603972.280090:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 56 00000100:00100000:3.0:1787603972.280102:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:10402:x1874438345753984:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787603972.280121:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603972.280141:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a90 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603972.280383:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787603972.280565:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901883 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a90 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.280593:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:3.0:1787603972.280596:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787603972.280601:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a90 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.280612:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac000, rc 0) 00000100:00100000:3.0:1787603972.280684:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+38:10402:x1874438345753984:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 584us (1261us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787603972.280690:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 56 00000100:00100000:1.0:1787603972.285444:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603972.285610:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345754240 00000100:00100000:2.0:1787603972.285621:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345754240 00000100:00100000:2.0:1787603972.285680:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00100000:2.0:1787603972.285691:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+38:10402:x1874438345754240:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:2.0:1787603972.286477:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+39:10402:x1874438345754240:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 777us (1032us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787603972.286496:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00100000:1.0:1787603972.406199:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603972.406332:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345754496 00000100:00100000:3.0:1787603972.406344:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345754496 00000100:00100000:3.0:1787603972.406459:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 57 00000100:00100000:3.0:1787603972.406483:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+39:10408:x1874438345754496:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:3.0:1787603972.406508:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603972.406529:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901891 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.406624:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.406638:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a89 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.406647:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.406682:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a89 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.406709:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a89 expref: 40 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603972.406722:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d1bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355219584:192.168.202.21@tcp:104: 00000100:00100000:3.0:1787603972.406826:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa69fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787603972.412375:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603972.412493:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345754624 00000100:00100000:1.0:1787603972.412504:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345754624 00010000:00010000:1.0:1787603972.412544:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a89 expref: 41 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603972.412581:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 40 00000100:00100000:1.0:1787603972.412590:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+41:2363:x1874438345754624:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603972.412605:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603972.412611:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a89 expref: 41 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603972.412623:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a89 expref: 41 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603972.412643:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:1.0:1787603972.412647:0:6693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603972.412655:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603972.412662:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603972.412678:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603972.412725:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+41:2363:x1874438345754624:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 137us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603972.412763:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 40 00010000:00010000:3.0:1787603972.415586:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190187c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a89 expref: 40 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603972.415611:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d1bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355219584:192.168.202.21@tcp:104: 00010000:00010000:3.0:1787603972.415633:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.415641:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.415646:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603972.415666:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787603972.416061:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901891 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a97 expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.416076:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a97 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.416084:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603972.416100:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787603972.416103:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad000, rc 0) 00000100:00100000:3.0:1787603972.416176:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+40:10408:x1874438345754496:12345-192.168.202.21@tcp:101:bash.0 Request processed in 9695us (9986us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787603972.416185:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 57 00000100:00100000:0.0:1787603972.419878:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603972.420015:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345754880 00000100:00100000:3.0:1787603972.420025:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345754880 00000100:00100000:3.0:1787603972.420071:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 58 00000100:00100000:3.0:1787603972.420080:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+40:10408:x1874438345754880:12345-192.168.202.21@tcp:36:bash.0 00010000:00010000:3.0:1787603972.420658:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19018a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.420678:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19018a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.420689:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19018a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787603972.420758:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1787603972.421705:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa71609f reply state 000000005ae8d3a6 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19018a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603972.421718:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787603972.421944:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+43:10408:x1874438345754880:12345-192.168.202.21@tcp:36:bash.0 Request processed in 1859us (2069us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787603972.421953:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 58 00000020:00080000:3.0:1787603972.422229:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787603972.424576:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19018a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.424592:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19018a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.424599:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19018a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.424605:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603972.424609:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19018a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.424616:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19018a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.424632:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:2.0:1787603972.424635:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603972.424640:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19018a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.424646:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19018a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603972.431077:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603972.431224:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345755008 00000100:00100000:2.0:1787603972.431236:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345755008 00000100:00100000:2.0:1787603972.431294:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 59 00000100:00100000:2.0:1787603972.431305:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+42:10408:x1874438345755008:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:2.0:1787603972.431330:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603972.431365:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a19018ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5a9e expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.431444:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19018b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.431458:0:7875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a97 expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.431466:0:7875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19018b4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.431514:0:7875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a97 expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.431528:0:7875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a97 expref: 43 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603972.431543:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355219712:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787603972.431628:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9cfe240 going to sleep for 11 seconds 00000100:00100000:1.0:1787603972.434743:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603972.434974:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345755136 00000100:00100000:3.0:1787603972.434985:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345755136 00010000:00010000:3.0:1787603972.435025:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a97 expref: 44 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603972.435082:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 41 00000100:00100000:3.0:1787603972.435094:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+44:2364:x1874438345755136:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787603972.435108:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603972.435115:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a97 expref: 44 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.435128:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a97 expref: 44 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.435148:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603972.435154:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19018b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.435162:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19018b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.435169:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19018b4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.435189:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603972.435248:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+44:2364:x1874438345755136:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 156us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603972.435256:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 41 00010000:00010000:2.0:1787603972.440177:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901898 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a97 expref: 43 pid: 5822 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603972.440205:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355219712:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787603972.440235:0:7875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19018b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.440244:0:7875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19018b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.440270:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19018b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787603972.440319:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787603972.440324:0:7875:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787603972.440358:0:7875:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19018b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.440394:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a19018ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a9e expref: 43 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.440409:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19018b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a9e expref: 42 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.440418:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:2.0:1787603972.440421:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787603972.440424:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962e00, rc 0) 00000100:00100000:2.0:1787603972.440513:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+42:10408:x1874438345755008:12345-192.168.202.21@tcp:101:bash.0 Request processed in 9208us (9445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603972.440521:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 59 00000100:00100000:1.0:1787603972.456035:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603972.456234:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345755392 00000100:00100000:3.0:1787603972.456245:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345755392 00000100:00100000:3.0:1787603972.456308:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15 00000100:00100000:3.0:1787603972.456318:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed291f97c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+42:10408:x1874438345755392:12345-192.168.202.21@tcp:35:bash.0 00000100:00100000:3.0:1787603972.456765:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed291f97c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+43:10408:x1874438345755392:12345-192.168.202.21@tcp:35:bash.0 Request processed in 448us (741us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787603972.456773:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15 00010000:00010000:1.0:1787603972.504127:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787603972.568029:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787603972.621806:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603972.621989:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345755648 00000100:00100000:2.0:1787603972.622000:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345755648 00000100:00100000:2.0:1787603972.622059:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 60 00000100:00100000:2.0:1787603972.622071:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+43:10418:x1874438345755648:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:2.0:1787603972.622097:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603972.622117:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a19018bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5aa5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787603972.622403:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787603972.622821:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a19018bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aa5 expref: 45 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.622865:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:2.0:1787603972.622868:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787603972.622874:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a19018bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aa5 expref: 45 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.622888:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962600, rc 0) 00000100:00100000:2.0:1787603972.622955:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+44:10418:x1874438345755648:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 886us (1158us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787603972.622963:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 60 00000100:00100000:1.0:1787603972.631005:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603972.631150:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345755776 00000100:00100000:0.0:1787603972.631172:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345755776 00000100:00100000:0.0:1787603972.631236:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 61 00000100:00100000:0.0:1787603972.631247:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+44:10418:x1874438345755776:12345-192.168.202.21@tcp:34:lfs.0 00010000:00010000:0.0:1787603972.631321:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19018c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631350:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19018c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631363:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19018c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631379:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19018d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631387:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19018d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631394:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19018d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631683:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19018d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631703:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19018d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631710:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19018d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787603972.631763:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19018d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631776:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19018c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631781:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19018c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631789:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19018c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631795:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603972.631798:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19018c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631805:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19018c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631817:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:0.0:1787603972.631820:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603972.631824:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19018c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631830:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19018c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631888:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19018d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631894:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19018d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631899:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19018d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631904:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603972.631907:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19018d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631912:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19018d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631919:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed28870b100) 00010000:00010000:0.0:1787603972.631921:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603972.631924:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19018d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631928:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a19018d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631942:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19018d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631948:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19018d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631952:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19018d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631963:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603972.631966:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19018d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631972:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19018d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631979:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:0.0:1787603972.631981:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603972.631983:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19018d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603972.631988:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19018d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603972.632066:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+44:10418:x1874438345755776:12345-192.168.202.21@tcp:34:lfs.0 Request processed in 819us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603972.632074:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 61 00000100:00100000:1.0:1787603972.636053:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603972.636155:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345756032 00000100:00100000:2.0:1787603972.636176:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345756032 00000100:00100000:2.0:1787603972.636237:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:2.0:1787603972.636247:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+44:10418:x1874438345756032:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:2.0:1787603972.636709:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+45:10418:x1874438345756032:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 461us (662us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787603972.636717:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:2.0:1787603972.762403:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603972.762961:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345756288 00000100:00100000:3.0:1787603972.762973:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345756288 00000100:00100000:3.0:1787603972.763081:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 62 00000100:00100000:3.0:1787603972.763094:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+45:10421:x1874438345756288:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787603972.763119:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603972.763141:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19018de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5aac expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.763229:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19018e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.763243:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19018e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.763253:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19018e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.763268:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19018ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.763276:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19018ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.763282:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19018ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.764293:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19018f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.764313:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19018f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.764321:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19018f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603972.764338:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787603972.764431:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19018e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.764438:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19018e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.764445:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19018e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.764450:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603972.764453:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19018e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.766147:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19018e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.766347:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:3.0:1787603972.766350:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603972.766357:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19018e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.766364:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19018e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.766383:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19018ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.766406:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19018ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.766413:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19018ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.766420:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603972.766425:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19018ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.766431:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19018ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.766439:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed290d35900) 00010000:00010000:3.0:1787603972.766441:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603972.766444:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19018ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.766450:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19018ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.767654:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19018de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aac expref: 48 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.767673:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19018f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aac expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.767682:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603972.767685:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787603972.767699:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad000, rc 0) 00000100:00100000:3.0:1787603972.767817:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+47:10421:x1874438345756288:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 4724us (5423us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787603972.767825:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 62 00000100:00100000:1.0:1787603972.779894:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603972.779936:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603972.780014:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345756544 00000100:00100000:2.0:1787603972.780025:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345756544 00000100:00100000:2.0:1787603972.780092:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:2.0:1787603972.780103:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+47:2363:x1874438345756544:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603972.780132:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603972.780155:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19018f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aac expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603972.780186:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:2.0:1787603972.780192:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603972.780245:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+46:2363:x1874438345756544:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 143us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603972.780252:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:3.0:1787603972.785951:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345756416 00000100:00100000:3.0:1787603972.785969:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345756416 00000100:00100000:3.0:1787603972.786031:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 63 00000100:00100000:3.0:1787603972.786043:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+46:10421:x1874438345756416:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:3.0:1787603972.786118:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901901 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.786136:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.786147:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.786184:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.786191:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901901 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.786198:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.786204:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603972.786208:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.786216:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901901 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.786244:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603972.786247:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787603972.786252:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901901 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603972.786258:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901901 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603972.786350:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+46:10421:x1874438345756416:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 309us (6465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603972.786358:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 63 00000100:00100000:1.0:1787603972.790083:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603972.790192:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345756800 00000100:00100000:2.0:1787603972.790202:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345756800 00000100:00100000:2.0:1787603972.790262:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:2.0:1787603972.790274:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+46:10421:x1874438345756800:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:2.0:1787603972.790524:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+47:10421:x1874438345756800:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 252us (448us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787603972.790533:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17 00000004:00080000:3.0:1787603973.079068:0:6872:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 306143227440ns, next at 307143224492ns, rc = 0 00000100:00100000:2.0:1787603973.079186:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787603973.079209:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355219840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787603973.079278:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603973.079455:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355220224:0@lo:400:kworker.0 00000100:00100000:3.0:1787603973.079485:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603973.079507:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787603973.079513:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355220352:0@lo:400:kworker.0 00000100:00100000:3.0:1787603973.079536:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603973.079569:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355220224 00000100:00100000:3.0:1787603973.079576:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355220224 00000100:00100000:3.0:1787603973.079625:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355220352 00000100:00100000:3.0:1787603973.079628:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355220352 00000100:00100000:3.0:1787603973.079650:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787603973.079659:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355220224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603973.079704:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355220224:12345-0@lo:400:kworker.0 Request processed in 46us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603973.079710:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787603973.079739:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787603973.079760:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355220352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603973.079789:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355220352:12345-0@lo:400:kworker.0 Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603973.079794:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1787603973.079812:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603973.079861:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355220352:0@lo:400:kworker.0 00000100:00100000:3.0:1787603973.079873:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355220224:0@lo:400:kworker.0 00000100:00100000:1.0:1787603973.079977:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355220096:0@lo:400:kworker.0 00000100:00100000:1.0:1787603973.080010:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603973.080039:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787603973.080045:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355219968:0@lo:400:kworker.0 00000100:00100000:1.0:1787603973.080073:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603973.080099:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355220480:0@lo:400:kworker.0 00000100:00100000:1.0:1787603973.080122:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603973.080149:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355219968 00000100:00100000:1.0:1787603973.080153:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355219968 00000100:00100000:1.0:1787603973.080179:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787603973.080186:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355219968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603973.080220:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355219968:12345-0@lo:400:kworker.0 Request processed in 35us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603973.080226:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787603973.080251:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355220480 00000100:00100000:1.0:1787603973.080261:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355220480 00000100:00100000:1.0:1787603973.080293:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787603973.080300:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355220480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603973.080330:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355220480:12345-0@lo:400:kworker.0 Request processed in 31us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603973.080336:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787603973.080353:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787603973.080367:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355219968:0@lo:400:kworker.0 00000100:00100000:1.0:1787603973.080377:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355220480:0@lo:400:kworker.0 00000100:00100000:3.0:1787603973.080769:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355220096 00000100:00100000:3.0:1787603973.080774:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355220096 00000100:00100000:3.0:1787603973.080807:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787603973.080815:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355220096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603973.080879:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355220096:12345-0@lo:400:kworker.0 Request processed in 66us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603973.080885:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787603973.081559:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355220096:0@lo:400:kworker.0 00000100:00100000:0.0:1787603973.081664:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355219840 00000100:00100000:0.0:1787603973.081671:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355219840 00000100:00100000:0.0:1787603973.081734:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787603973.081743:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355219840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787603973.081772:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603973.081825:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355219840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (2547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603973.081833:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787603973.081896:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355219840:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787603973.082115:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603973.193174:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603973.193313:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345757056 00000100:00100000:0.0:1787603973.193355:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345757056 00000100:00100000:0.0:1787603973.193588:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 64 00000100:00100000:0.0:1787603973.193600:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+47:10439:x1874438345757056:12345-192.168.202.21@tcp:101:cat.0 00010000:00010000:0.0:1787603973.193635:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603973.193664:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901908 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ab3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.193820:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190190f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.194071:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190190f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.194090:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190190f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603973.194104:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787603973.194281:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901908 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ab3 expref: 50 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.194308:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190190f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ab3 expref: 49 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.194318:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:0.0:1787603973.194322:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787603973.194339:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594800, rc 0) 00000100:00100000:0.0:1787603973.194539:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10439:x1874438345757056:12345-192.168.202.21@tcp:101:cat.0 Request processed in 940us (1377us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787603973.194548:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 64 00000100:00100000:1.0:1787603973.250879:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603973.251023:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345757184 00000100:00100000:3.0:1787603973.251038:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345757184 00000100:00100000:3.0:1787603973.251113:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 65 00000100:00100000:3.0:1787603973.251125:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10440:x1874438345757184:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787603973.251158:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603973.251184:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190191d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5aba expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.251271:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.251289:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.251317:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603973.251678:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787603973.251683:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787603973.251777:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.251815:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190191d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aba expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.251967:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aba expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.251980:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:3.0:1787603973.251983:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787603973.251988:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac000, rc 0) 00000100:00100000:3.0:1787603973.252077:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:10440:x1874438345757184:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 953us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603973.252085:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 65 00000100:00100000:1.0:1787603973.268313:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603973.268819:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345757568 00000100:00100000:2.0:1787603973.268833:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345757568 00000100:00100000:2.0:1787603973.269053:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 18 00000100:00100000:2.0:1787603973.269067:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:10440:x1874438345757568:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:2.0:1787603973.270054:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:10440:x1874438345757568:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 985us (1753us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787603973.270088:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 18 00000100:00100000:1.0:1787603973.281054:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603973.281200:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345757696 00000100:00100000:3.0:1787603973.281214:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345757696 00000100:00100000:3.0:1787603973.281303:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:3.0:1787603973.281317:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:10440:x1874438345757696:12345-192.168.202.21@tcp:103:lfs.0 00010000:00010000:3.0:1787603973.281379:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787603973.281423:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19018b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a9e expref: 51 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.281742:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190190f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ab3 expref: 50 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.281759:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a19017bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a5f expref: 49 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.281781:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603973.281793:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603973.281936:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+48:10440:x1874438345757696:12345-192.168.202.21@tcp:103:lfs.0 Request processed in 621us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603973.281946:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:1.0:1787603973.285027:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603973.285117:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345757824 00000100:00100000:3.0:1787603973.285131:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345757824 00000100:00100000:3.0:1787603973.285205:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 66 00000100:00100000:3.0:1787603973.285216:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+48:10440:x1874438345757824:12345-192.168.202.21@tcp:58:lfs.0 00010000:00010000:3.0:1787603973.285363:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190192b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.285384:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190192b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.285407:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190192b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787603973.286215:0:7875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787603973.286776:0:7875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787603973.286900:0:7875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787603973.287060:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+48:10440:x1874438345757824:12345-192.168.202.21@tcp:58:lfs.0 Request processed in 1838us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603973.287071:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 66 00000100:00100000:1.0:1787603973.329127:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603973.329240:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345757952 00000100:00100000:2.0:1787603973.329254:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345757952 00000100:00100000:2.0:1787603973.329330:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 67 00000100:00100000:2.0:1787603973.329344:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+48:10442:x1874438345757952:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:2.0:1787603973.329371:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603973.329409:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901932 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ac1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.329507:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901939 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.329524:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901939 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.329536:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901939 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.329553:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901940 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.329560:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330004:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330367:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330378:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330397:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787603973.330443:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787603973.330448:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787603973.330672:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330687:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330697:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901939 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330704:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901939 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330721:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330735:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963a00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603973.330740:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330758:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901939 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330782:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:2.0:1787603973.330787:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603973.330792:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901939 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330799:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901939 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330813:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330818:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901940 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330824:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330831:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603973.330834:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330886:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901940 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330894:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed2b2e8ba00) 00010000:00010000:2.0:1787603973.330896:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603973.330899:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901940 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330916:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901940 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330959:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901932 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ac1 expref: 50 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330974:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ac1 expref: 49 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.330982:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed290d35900) 00010000:00010000:2.0:1787603973.330984:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787603973.330987:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963600, rc 0) 00000100:00100000:2.0:1787603973.331075:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10442:x1874438345757952:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 1734us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603973.331084:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 67 00010000:00010000:1.0:1787603973.527128:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787603973.591987:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787603973.592001:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787603973.592068:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787603973.592075:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787603973.592249:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874438355220608:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787603973.592658:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787603973.597634:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787603973.597662:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355220736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787603973.597772:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603973.597866:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355220736 00000100:00100000:0.0:1787603973.597876:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355220736 00000100:00100000:0.0:1787603973.597944:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787603973.597956:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355220736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787603973.598005:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603973.598057:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355220736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603973.598065:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787603973.598119:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355220736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787603973.621616:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603973.621912:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf470e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874438355220608:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787603973.622235:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345758080 00000100:00100000:3.0:1787603973.622245:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345758080 00000100:00100000:3.0:1787603973.622324:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1 00000100:00100000:3.0:1787603973.622334:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10453:x1874438345758080:12345-192.168.202.21@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787603973.622444:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10453:x1874438345758080:12345-192.168.202.21@tcp:900:lhsmtool_posix.0 Request processed in 110us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603973.622462:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1 00000100:00100000:3.0:1787603973.626767:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603973.626968:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345758208 00000100:00100000:0.0:1787603973.626981:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345758208 00000100:00100000:0.0:1787603973.627047:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 68 00000100:00100000:0.0:1787603973.627058:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10453:x1874438345758208:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787603973.627116:0:5821:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787603973.627251:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10453:x1874438345758208:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 Request processed in 195us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603973.627260:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 68 00000100:00100000:3.0:1787603973.637085:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603973.637202:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345758336 00000100:00100000:0.0:1787603973.637216:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345758336 00000100:00100000:0.0:1787603973.637294:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 69 00000100:00100000:0.0:1787603973.637307:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10453:x1874438345758336:12345-192.168.202.21@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787603973.637423:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a190194e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.637471:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a190194e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.637486:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a190194e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639226:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901955 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639248:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901955 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639260:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901955 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639297:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190195c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639305:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190195c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639311:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190195c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603973.639358:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787603973.639362:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787603973.639379:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190195c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639391:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a190194e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639413:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a190194e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639419:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a190194e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639424:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595c00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603973.639428:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a190194e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639435:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a190194e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639447:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed290d35200) 00010000:00010000:0.0:1787603973.639450:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603973.639454:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a190194e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639460:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a190194e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639475:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901955 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639482:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901955 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639488:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901955 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639493:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603973.639502:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901955 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639509:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901955 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639516:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9ed28870b100) 00010000:00010000:0.0:1787603973.639518:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603973.639521:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901955 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639526:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901955 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639543:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190195c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639549:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190195c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639554:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190195c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639559:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603973.639562:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190195c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639567:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190195c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639575:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed290d35900) 00010000:00010000:0.0:1787603973.639577:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603973.639586:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190195c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.639593:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190195c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603973.639698:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10453:x1874438345758336:12345-192.168.202.21@tcp:34:lhsmtool_posix.0 Request processed in 2389us (2623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603973.639708:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 69 00000100:00100000:1.0:1787603973.647330:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603973.647542:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345758592 00000100:00100000:3.0:1787603973.647556:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345758592 00000100:00100000:3.0:1787603973.647637:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 70 00000100:00100000:3.0:1787603973.647649:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10453:x1874438345758592:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787603973.647676:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603973.647701:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901963 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ac8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.647987:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190196a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.648007:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190196a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.648021:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190196a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603973.648036:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787603973.648164:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190196a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.648172:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190196a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.648196:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190196a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.648203:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603973.648208:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190196a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.648217:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190196a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.648232:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed290d35900) 00010000:00010000:3.0:1787603973.648236:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787603973.648242:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190196a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.648249:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190196a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.648301:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901963 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ac8 expref: 51 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.648313:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed290d35200) 00010000:00010000:3.0:1787603973.648316:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787603973.648320:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901963 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ac8 expref: 51 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.648330:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad200, rc 0) 00000100:00100000:3.0:1787603973.648744:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:10453:x1874438345758592:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 1095us (1427us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787603973.648762:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 70 00000100:00100000:3.0:1787603973.665744:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603973.665893:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345758720 00000100:00100000:2.0:1787603973.665909:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345758720 00000100:00100000:2.0:1787603973.665986:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 71 00000100:00100000:2.0:1787603973.665998:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:10453:x1874438345758720:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787603973.666050:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787603973.666188:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:10453:x1874438345758720:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 Request processed in 191us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603973.666195:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 71 00000100:00100000:1.0:1787603973.672774:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603973.672919:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345758976 00000100:00100000:2.0:1787603973.672943:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345758976 00000100:00100000:2.0:1787603973.673020:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 72 00000100:00100000:2.0:1787603973.673034:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:10453:x1874438345758976:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787603973.673063:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603973.673067:0:7875:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787603973.673103:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901924 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aba expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.673128:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:2.0:1787603973.673134:0:7875:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787603973.673151:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901978 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5acf expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787603973.674247:0:7875:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787603973.677954:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190197f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.677986:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190197f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.678002:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190197f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.678120:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901978 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5acf expref: 52 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.678149:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190197f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5acf expref: 51 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.678159:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed290d35e00) 00010000:00010000:3.0:1787603973.678162:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787603973.678166:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dadc00, rc 0) 00000100:00100000:3.0:1787603973.678265:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:10453:x1874438345758976:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 5233us (5506us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787603973.678276:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 72 00000100:00100000:2.0:1787603973.692167:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603973.694775:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345759232 00000100:00100000:3.0:1787603973.694794:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345759232 00000100:00100000:3.0:1787603973.694886:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 73 00000100:00100000:3.0:1787603973.694900:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:10453:x1874438345759232:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787603973.694993:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603973.695027:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a190197f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5acf expref: 51 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.695050:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed290d35e00) 00010000:00010000:3.0:1787603973.695063:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787603973.695106:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190198d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.695122:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190198d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.695133:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190198d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.695304:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901994 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd282f61d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.695326:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901994 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd282f61d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.695405:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901994 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd282f61d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696626:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190198d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696648:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190198d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696654:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190198d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696666:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603973.696671:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190198d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696677:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190198d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696691:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:3.0:1787603973.696693:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603973.696698:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190198d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696703:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a190198d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696871:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901994 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd282f61d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696879:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901994 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd282f61d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696884:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901994 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd282f61d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696889:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603973.696892:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901994 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd282f61d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696897:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901994 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd282f61d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.696916:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd282f61d (ffff9ed290d35000) 00010000:00010000:3.0:1787603973.696918:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603973.696922:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901994 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd282f61d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.697100:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901994 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd282f61d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603973.697221:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:10453:x1874438345759232:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 2318us (5062us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787603973.697231:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 73 00000100:00100000:3.0:1787603973.710601:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603973.712872:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345759360 00000100:00100000:0.0:1787603973.712894:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345759360 00000100:00100000:0.0:1787603973.712997:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 74 00000100:00100000:0.0:1787603973.713011:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:10453:x1874438345759360:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787603973.713041:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603973.713075:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190199b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ad6 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.713123:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19019a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.713150:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19019a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.713163:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19019a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.713293:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a190199b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ad6 expref: 52 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.713314:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19019a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ad6 expref: 51 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.713332:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed28870b100) 00010000:00010000:0.0:1787603973.713335:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787603973.713339:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594000, rc 0) 00000100:00100000:0.0:1787603973.713427:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:10453:x1874438345759360:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 419us (2836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603973.713435:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 74 00000100:00100000:3.0:1787603973.719327:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603973.719456:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345759616 00000100:00100000:0.0:1787603973.719472:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345759616 00000100:00100000:0.0:1787603973.719548:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 75 00000100:00100000:0.0:1787603973.719560:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:10453:x1874438345759616:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787603973.719671:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.719694:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.719708:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787603973.720158:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1787603973.720170:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306784332122ns, next at 307784328929ns, rc = 0 00000004:00010000:0.0:1787603973.720286:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006eed8823 reply state 000000007cd3e019 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603973.720298:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787603973.720418:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+53:10453:x1874438345759616:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 858us (1103us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787603973.720445:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 75 00010000:00010000:3.0:1787603973.724963:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.724988:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.724997:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.725004:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603973.725009:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.725018:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.725040:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed28870b100) 00010000:00010000:3.0:1787603973.725051:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787603973.725057:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.725063:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603973.727667:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603973.727753:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345759744 00000100:00100000:0.0:1787603973.727771:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345759744 00000100:00100000:0.0:1787603973.727882:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 76 00000100:00100000:0.0:1787603973.727896:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:10453:x1874438345759744:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787603973.727928:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603973.727956:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19019b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5add expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.728038:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19019b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5add expref: 53 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.728056:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19019b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5add expref: 53 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.728080:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed28870b100) 00010000:00010000:0.0:1787603973.728083:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787603973.728087:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594400, rc 0) 00000100:00100000:0.0:1787603973.728159:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+53:10453:x1874438345759744:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 266us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603973.728167:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 76 00000100:00100000:0.0:1787603973.736914:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603973.737014:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345759872 00000100:00100000:1.0:1787603973.737027:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345759872 00000100:00100000:1.0:1787603973.737077:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 24 00000100:00100000:1.0:1787603973.737087:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1874438345759872:12345-192.168.202.21@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787603973.737127:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:1.0:1787603973.737166:0:6676:0:(genops.c:1385:class_connect()) connect: client a45d6158-dc8e-48e6-b534-483bf3fa20ad, cookie 0xb5d1f3b1a19019b7 00002000:00100000:1.0:1787603973.737180:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a45d6158-dc8e-48e6-b534-483bf3fa20ad/ffff9ed2863f6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787603973.737192:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:1.0:1787603973.737469:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787603973.737504:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9ed2863f3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787603973.737592:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2362:x1874438345759872:12345-192.168.202.21@tcp:8:lhsmtool_posix.0 Request processed in 505us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603973.737600:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 24 00000100:00100000:2.0:1787603973.751127:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603973.751214:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345760000 00000100:00100000:1.0:1787603973.751227:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345760000 00000100:00100000:1.0:1787603973.751331:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 25 00000100:00100000:1.0:1787603973.751344:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:0:x1874438345760000:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787603973.753231:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787603973.814431:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:0:x1874438345760000:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 Request processed in 63072us (63301us total) trans 4294967301 rc 0/0 00000001:00080000:2.0:1787603973.814439:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1787603973.814452:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 25 00000001:00100000:2.0:1787603973.814460:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000100:00100000:0.0:1787603973.840048:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603973.840162:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345760256 00000100:00100000:3.0:1787603973.840175:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345760256 00000100:00100000:3.0:1787603973.840262:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:3.0:1787603973.840275:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+53:10453:x1874438345760256:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787603973.840626:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:10453:x1874438345760256:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 352us (590us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787603973.840634:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:0.0:1787603973.854300:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603973.854738:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345760512 00000100:00100000:3.0:1787603973.854752:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345760512 00000100:00100000:3.0:1787603973.854890:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 77 00000100:00100000:3.0:1787603973.854907:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:10453:x1874438345760512:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787603973.855068:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:10453:x1874438345760512:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 166us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603973.855077:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 77 00000100:00100000:0.0:1787603973.859765:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603973.859928:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345760640 00000100:00100000:3.0:1787603973.859943:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345760640 00000100:00100000:3.0:1787603973.860019:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 78 00000100:00100000:3.0:1787603973.860031:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:10453:x1874438345760640:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787603973.860057:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603973.860103:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19019be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ae4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.860192:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19019c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.860209:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19019c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.860234:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19019c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603973.860281:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787603973.860305:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19019c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.860356:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19019be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ae4 expref: 56 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.860376:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19019c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ae4 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.860387:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed28870b100) 00010000:00010000:3.0:1787603973.860390:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787603973.860395:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad200, rc 0) 00000100:00100000:3.0:1787603973.860796:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10453:x1874438345760640:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 765us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603973.860804:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 78 00000100:00100000:1.0:1787603973.865220:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603973.865335:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345760768 00000100:00100000:2.0:1787603973.865348:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345760768 00000100:00100000:2.0:1787603973.865418:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 26 00000100:00100000:2.0:1787603973.865431:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2364:x1874438345760768:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787603973.865466:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603973.865497:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000501b2eea/0xb5d1f3b1a19019cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5aeb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787603973.865535:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8cac05, blocks: 0x1 00010000:00010000:2.0:1787603973.865566:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=306s v=(0 0) 00010000:00010000:2.0:1787603973.865572:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787603973.865583:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000501b2eea/0xb5d1f3b1a19019cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aeb expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.865608:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000501b2eea/0xb5d1f3b1a19019cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aeb expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603973.865626:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962800, rc 0) 00000100:00100000:2.0:1787603973.865710:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345760768:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 275us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603973.865725:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 26 00000100:00100000:0.0:1787603973.872050:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603973.872213:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345761024 00000100:00100000:3.0:1787603973.872238:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345761024 00000100:00100000:3.0:1787603973.872317:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 79 00000100:00100000:3.0:1787603973.872489:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10453:x1874438345761024:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787603973.872642:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10453:x1874438345761024:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 158us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603973.874019:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 79 00000100:00100000:1.0:1787603973.879918:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603973.882403:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345761152 00000100:00100000:3.0:1787603973.882425:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345761152 00000100:00100000:3.0:1787603973.882580:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 27 00000100:00100000:3.0:1787603973.882594:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:10453:x1874438345761152:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787603973.882618:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603973.882648:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5af2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.882689:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000501b2eea/0xb5d1f3b1a19019cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aeb expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.882699:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787603973.882828:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787603973.882862:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af2 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.882911:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000501b2eea/0xb5d1f3b1a19019cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aeb expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603973.882928:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000501b2eea/0xb5d1f3b1a19019cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aeb expref: 7 pid: 6676 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603973.882973:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874438355220864:192.168.202.21@tcp:104: 00000100:00100000:3.0:1787603973.883153:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28670a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787603973.910679:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874438355220864:192.168.202.21@tcp:104: 00000100:00100000:3.0:1787603973.911925:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:0.0:1787603973.912048:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af2 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603973.912079:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac200, rc 0) 00000100:00100000:1.0:1787603973.912211:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345761280 00000100:00100000:1.0:1787603973.912548:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345761280 00010000:00010000:1.0:1787603973.913024:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000501b2eea/0xb5d1f3b1a19019cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aeb expref: 8 pid: 6676 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603973.913094:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 42 00000100:00100000:1.0:1787603973.913107:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa48c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2363:x1874438345761280:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603973.913126:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603973.913156:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000501b2eea/0xb5d1f3b1a19019cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aeb expref: 8 pid: 6676 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603973.913171:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000501b2eea/0xb5d1f3b1a19019cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aeb expref: 8 pid: 6676 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603973.913202:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000501b2eea/0xb5d1f3b1a19019cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5aeb expref: 8 pid: 6676 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603973.913219:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1787603973.917549:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:10453:x1874438345761152:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 34938us (37624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603973.917574:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 27 00010000:00010000:1.0:1787603973.918465:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603973.918487:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af2 expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603973.918505:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af2 expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603973.918685:0:6693:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af2 expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603973.918781:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6693:1874438355220992:192.168.202.21@tcp:105: 00000100:00100000:1.0:1787603973.918911:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787603973.926609:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6693:1874438355220992:192.168.202.21@tcp:105: 00010000:00010000:0.0:1787603973.926648:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603973.927430:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa48c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345761280:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 14320us (15506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603973.927445:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 42 00000100:00100000:1.0:1787603973.931679:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603973.932895:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345761408 00000100:00100000:0.0:1787603973.932915:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345761408 00002000:00100000:0.0:1787603973.932989:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ed2bf31d880 x1874438345761408/t0(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:299/0 lens 504/0 e 0 to 0 dl 1787603984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787603973.933003:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2bf31d880 with x1874438345761408 ext(0->8) 00002000:00010000:0.0:1787603973.933010:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2bf31d880 00000100:00100000:0.0:1787603973.933050:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:0.0:1787603973.933062:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345761408:12345-192.168.202.21@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787603973.937421:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2363:x1874438345761408:12345-192.168.202.21@tcp:4:lhsmtool_posix.0 Request processed in 4345us (5739us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787603973.937440:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 0 00002000:00100000:0.0:1787603973.937457:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ed2bf31d880 x1874438345761408/t4294967302(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:299/0 lens 504/448 e 0 to 0 dl 1787603984 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787603973.937475:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2bf31d880 with x1874438345761408 ext(0->8) 00002000:00010000:0.0:1787603973.937483:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2bf31d880 00000100:00100000:1.0:1787603973.956147:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603973.956276:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345761536 00000100:00100000:2.0:1787603973.956290:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345761536 00000100:00100000:2.0:1787603973.956382:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 80 00000100:00100000:2.0:1787603973.956397:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10453:x1874438345761536:12345-192.168.202.21@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787603974.078368:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1787603974.078382:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:3.0:1787603974.078511:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355221120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787603974.078919:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787603974.079037:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787603974.079132:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355221248:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787603974.079162:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1787603974.085662:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1787603974.085679:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787603974.085731:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2aa69f000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787603974.085737:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed2ba281600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2aa69fcc0 00000020:00080000:2.0:1787603974.085740:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed2ba281000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2bececc00 00000020:00080000:2.0:1787603974.085779:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787603974.085979:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787603974.093319:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355221120 00000100:00100000:1.0:1787603974.093334:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355221120 00000100:00100000:1.0:1787603974.093390:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355221248 00000100:00100000:1.0:1787603974.093393:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355221248 00000100:00100000:1.0:1787603974.093416:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787603974.093425:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355221120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787603974.094014:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:10453:x1874438345761536:12345-192.168.202.21@tcp:44:lhsmtool_posix.0 Request processed in 137616us (137878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603974.094024:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 80 00002000:00010000:1.0:1787603974.096668:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787603974.096676:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787603973 00002000:00010000:1.0:1787603974.096680:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787603974.096682:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787603973 -> 1787603973 00002000:00010000:1.0:1787603974.096684:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787603974.096779:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355221120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3352us (17857us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787603974.096789:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787603974.096820:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787603974.096831:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1874438355221248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787603974.096870:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787603974.096895:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8cac02, atime: 0x6a8cac02, ctime: 0x6a8cac02, blocks: 0x1 00010000:00010000:1.0:1787603974.096903:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008981af02/0xb5d1f3b1a19019da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.096918:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:1.0:1787603974.096923:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603974.096929:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008981af02/0xb5d1f3b1a19019da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.096958:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008981af02/0xb5d1f3b1a19019da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.096969:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008981af02/0xb5d1f3b1a19019da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.096977:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008981af02/0xb5d1f3b1a19019da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.096994:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787603974.099339:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1787603974.099365:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603974.099372:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008981af02/0xb5d1f3b1a19019da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.099385:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fc00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787603974.099389:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008981af02/0xb5d1f3b1a19019da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.099401:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008981af02/0xb5d1f3b1a19019da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.099441:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008981af02/0xb5d1f3b1a19019da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.099688:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008981af02/0xb5d1f3b1a19019da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.099729:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603974.099732:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603974.099734:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603974.100339:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3282:x1874438355221248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3508us (21172us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787603974.100353:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787603974.100381:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345761664 00000100:00100000:1.0:1787603974.100388:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345761664 00000100:00100000:1.0:1787603974.100420:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00100000:1.0:1787603974.100429:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2364:x1874438345761664:12345-192.168.202.21@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1787603974.101965:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2bf213800/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787603974.101979:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355221248:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787603974.102752:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed285d19c00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787603974.102766:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355221120:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1787603974.145561:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1787603974.145586:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1787603974.145682:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345761664:12345-192.168.202.21@tcp:16:lhsmtool_posix.0 Request processed in 45241us (46338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603974.145698:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00100000:0.0:1787603974.170036:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603974.170106:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345761920 00000100:00100000:0.0:1787603974.170119:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345761920 00000100:00100000:0.0:1787603974.170209:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 81 00000100:00100000:0.0:1787603974.170224:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:10453:x1874438345761920:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787603974.170300:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603974.170352:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19019c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ae4 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.170376:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed28870b100) 00010000:00010000:0.0:1787603974.170381:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787603974.170422:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.170440:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.170450:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787603974.170765:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae4af2ec reply state 00000000029067a9 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603974.170794:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787603974.170946:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:10453:x1874438345761920:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 723us (927us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787603974.170954:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 81 00000100:00080000:2.0:1787603974.175292:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787603974.181165:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.181184:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.181194:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.181210:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603974.181216:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.181222:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.181240:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed28870b100) 00010000:00010000:3.0:1787603974.181258:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603974.181264:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.181272:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19019e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603974.182336:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603974.182760:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345762048 00000100:00100000:2.0:1787603974.182770:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345762048 00000100:00100000:2.0:1787603974.182828:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 31 00000100:00100000:2.0:1787603974.182873:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345762048:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787603974.183174:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787603974.183179:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787603973 -> 1787603972 00002000:00010000:1.0:1787603974.183194:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787603970 00002000:00010000:1.0:1787603974.183197:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787603973 -> 1787603972 00002000:00010000:1.0:1787603974.183200:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787603974.183261:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345762048:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 Request processed in 423us (930us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787603974.183278:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 31 00000100:00100000:1.0:1787603974.188925:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603974.189120:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345762304 00000100:00100000:3.0:1787603974.189133:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345762304 00000100:00100000:3.0:1787603974.189236:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 82 00000100:00100000:3.0:1787603974.189261:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:10453:x1874438345762304:12345-192.168.202.21@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787603974.189335:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.189353:0:7875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19019a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ad6 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.189362:0:7875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.189404:0:7875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19019a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ad6 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.189429:0:7875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19019a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ad6 expref: 13 pid: 5821 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603974.189458:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6139880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355221376:192.168.202.21@tcp:104: 00000100:00100000:3.0:1787603974.189726:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28670acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603974.199386:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603974.199484:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6139880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355221376:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603974.199535:0:7875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603974.201477:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345762432 00000100:00100000:2.0:1787603974.201494:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345762432 00010000:00010000:2.0:1787603974.201554:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19019a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ad6 expref: 14 pid: 5821 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603974.201608:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 43 00000100:00100000:2.0:1787603974.201620:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:2364:x1874438345762432:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603974.201639:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603974.201647:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19019a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ad6 expref: 14 pid: 5821 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.201662:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19019a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ad6 expref: 14 pid: 5821 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.201689:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a19019a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ad6 expref: 14 pid: 5821 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.201711:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed28870b100) 00010000:00010000:2.0:1787603974.201728:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.201757:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.201766:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.201803:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787603974.201858:0:7875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.201875:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.201906:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603974.201907:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:2364:x1874438345762432:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 287us (2529us total) trans 0 rc 0/0 00010000:00010000:1.0:1787603974.201930:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603974.201932:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 43 00010000:00010000:1.0:1787603974.201949:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.201957:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dadc00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603974.201962:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.201970:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.201989:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed28870b100) 00010000:00010000:1.0:1787603974.201992:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787603974.201997:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.202003:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603974.202090:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+12:10453:x1874438345762304:12345-192.168.202.21@tcp:55:lhsmtool_posix.0 Request processed in 12839us (13176us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787603974.202113:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 82 00000100:00100000:1.0:1787603974.207210:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603974.207282:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345762560 00000100:00100000:2.0:1787603974.207300:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345762560 00000100:00100000:2.0:1787603974.207401:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 32 00000100:00100000:2.0:1787603974.207415:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345762560:12345-192.168.202.21@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787603974.207477:0:10671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.207504:0:10671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af2 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.207513:0:10671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787603974.207518:0:10671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787603974.207523:0:10671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.207570:0:10671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af2 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.207606:0:10671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af2 expref: 7 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603974.207625:0:10671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10671:1874438355221504:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787603974.207750:0:10671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed284e31540 going to sleep for 11 seconds 00000100:00100000:3.0:1787603974.213605:0:10671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10671:1874438355221504:192.168.202.21@tcp:104: 00010000:00010000:3.0:1787603974.213635:0:10671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603974.219186:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603974.219500:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345762688 00000100:00100000:2.0:1787603974.219515:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345762688 00010000:00010000:2.0:1787603974.219567:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af2 expref: 8 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603974.219618:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 44 00000100:00100000:2.0:1787603974.219630:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2364:x1874438345762688:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603974.219647:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603974.219677:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af2 expref: 8 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.219692:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af2 expref: 8 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.219731:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a19019d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af2 expref: 8 pid: 6678 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.219749:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787603974.219755:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787603974.219776:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.219788:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.219825:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787603974.219903:0:10671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.219924:0:10671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603974.219936:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2364:x1874438345762688:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 302us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603974.219949:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 44 00010000:00010000:3.0:1787603974.219970:0:10671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.219982:0:10671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.220002:0:10671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.220010:0:10671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963c00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787603974.220015:0:10671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.220023:0:10671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.220063:0:10671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.220071:0:10671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4bb278f/0xb5d1f3b1a19019ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603974.220242:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345762560:12345-192.168.202.21@tcp:1:lhsmtool_posix.0 Request processed in 12825us (13037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603974.220253:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 32 00000100:00100000:1.0:1787603974.235873:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603974.235953:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345762944 00000100:00100000:3.0:1787603974.235963:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345762944 00000100:00100000:3.0:1787603974.236275:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 83 00000100:00100000:3.0:1787603974.236287:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+12:10453:x1874438345762944:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787603974.236372:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19019f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.236391:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19019f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.236402:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19019f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.236654:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.236665:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19019b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5add expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.236685:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.236729:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19019b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5add expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.236744:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19019b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5add expref: 13 pid: 5821 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603974.236757:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355221632:192.168.202.21@tcp:104: 00000100:00100000:3.0:1787603974.236868:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28670a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787603974.239524:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355221632:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603974.239554:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603974.241679:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603974.242030:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345763072 00000100:00100000:3.0:1787603974.242047:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345763072 00010000:00010000:3.0:1787603974.242099:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19019b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5add expref: 14 pid: 5821 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603974.242156:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 45 00000100:00100000:3.0:1787603974.242173:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:2363:x1874438345763072:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787603974.242191:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603974.242199:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19019b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5add expref: 14 pid: 5821 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.242215:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19019b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5add expref: 14 pid: 5821 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.242241:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19019b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5add expref: 14 pid: 5821 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.242274:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed28870b100) 00010000:00010000:3.0:1787603974.242281:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.242291:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.242300:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.242442:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603974.242537:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:2363:x1874438345763072:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 370us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603974.242546:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 45 00010000:00010000:1.0:1787603974.243191:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.243216:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787603974.243422:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787603974.243574:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787603974.243619:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787603974.243742:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5823:1874438355221760:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787603974.243801:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603974.243867:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4300 going to sleep for 11 seconds 00000100:00100000:3.0:1787603974.243922:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355221760 00000100:00100000:3.0:1787603974.243933:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355221760 00000100:00100000:3.0:1787603974.243984:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787603974.243996:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1874438355221760:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787603974.244110:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1874438355221760:12345-0@lo:1000:mdt00_002.0 Request processed in 116us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603974.244118:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787603974.244370:0:5823:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787603974.244377:0:5823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed285d19c00, transno 4294967303 00000100:00100000:1.0:1787603974.244396:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5823:1874438355221760:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787603974.245025:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787603974.247387:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5823:1874438355221888:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787603974.247468:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603974.247515:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787603974.247548:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355221888 00000100:00100000:3.0:1787603974.247574:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355221888 00000100:00100000:3.0:1787603974.247647:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787603974.247658:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1874438355221888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787603974.248013:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1874438355221888:12345-0@lo:1000:mdt00_002.0 Request processed in 356us (544us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787603974.248036:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787603974.249517:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5823:1874438355221888:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787603974.249564:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249575:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249582:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249589:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dadc00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603974.249593:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249600:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249617:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed28870b100) 00010000:00010000:1.0:1787603974.249620:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787603974.249624:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249629:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a19019fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249667:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190192b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249674:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190192b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249679:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190192b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249693:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603974.249696:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190192b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249702:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190192b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249711:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed290d35900) 00010000:00010000:1.0:1787603974.249714:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787603974.249727:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190192b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249734:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a190192b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249757:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249771:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ac1 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249780:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249812:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ac1 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.249828:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ac1 expref: 16 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603974.249872:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355222016:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787603974.249964:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787603974.261361:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603974.262196:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345763200 00000100:00100000:0.0:1787603974.262223:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345763200 00010000:00010000:0.0:1787603974.262271:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ac1 expref: 17 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603974.262320:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 46 00000100:00100000:0.0:1787603974.262330:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:2364:x1874438345763200:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787603974.262345:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603974.262352:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ac1 expref: 17 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.262365:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ac1 expref: 17 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.262387:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed290d35900) 00010000:00010000:0.0:1787603974.262393:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.262420:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.262428:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.262452:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787603974.262488:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901947 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ac1 expref: 17 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603974.262511:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:2364:x1874438345763200:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 180us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603974.262513:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355222016:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603974.262532:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 46 00010000:00010000:2.0:1787603974.262555:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262568:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262575:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262589:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262595:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262615:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262631:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fc00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603974.262637:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262644:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262659:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed290d35900) 00010000:00010000:2.0:1787603974.262662:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603974.262666:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262672:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901a04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262683:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19019f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262688:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19019f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262694:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19019f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262699:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603974.262701:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19019f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262707:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19019f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262737:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed290d35900) 00010000:00010000:2.0:1787603974.262740:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787603974.262745:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19019f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.262751:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a19019f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603974.263081:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:10453:x1874438345762944:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 26795us (27241us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787603974.263090:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 83 00000020:00080000:2.0:1787603974.263096:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787603974.263322:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787603974.263328:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787603974.263361:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787603974.263367:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787603974.273924:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603974.274116:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345763456 00000100:00100000:1.0:1787603974.274132:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345763456 00000100:00100000:2.0:1787603974.274251:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00100000:2.0:1787603974.274272:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:10453:x1874438345763456:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787603974.274448:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1787603974.274459:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00080000:2.0:1787603974.275209:0:5824:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787603974.275327:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787603974.275381:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901a0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.275401:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901a0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.275414:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901a0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.275425:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901a0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.275432:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901a0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.275448:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901a0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.275472:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787603974.275507:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787603974.275520:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901a0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.275531:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963600 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787603974.275537:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901a0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.275547:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901a0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.275567:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ed2b2e8bb00) 00010000:00010000:1.0:1787603974.275571:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787603974.275576:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901a0b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.275583:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1901a0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603974.275605:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:10453:x1874438345763456:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 1338us (1694us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787603974.275616:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 20 00000020:00080000:2.0:1787603974.275625:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787603974.275824:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603974.275826:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603974.275828:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787603974.535899:0:11983:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787603974.535908:0:11983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787603974.535946:0:11983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787603974.535952:0:11983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787603974.556565:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603974.626787:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603974.626909:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345763712 00000100:00100000:1.0:1787603974.626920:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345763712 00000100:00100000:1.0:1787603974.626983:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 84 00000100:00100000:1.0:1787603974.627145:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:10464:x1874438345763712:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787603974.627173:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603974.627193:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901a12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5af9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.627475:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ea00/0xb5d1f3b1a1901a19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.627492:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ea00/0xb5d1f3b1a1901a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.627503:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ea00/0xb5d1f3b1a1901a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603974.627515:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787603974.627685:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901a12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af9 expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.627702:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ea00/0xb5d1f3b1a1901a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af9 expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.627711:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:1.0:1787603974.627731:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787603974.627735:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7ea00, rc 0) 00000100:00100000:1.0:1787603974.627794:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:10464:x1874438345763712:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 653us (1016us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787603974.635632:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603974.635667:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345763840 00000100:00100000:3.0:1787603974.635677:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345763840 00000100:00100000:3.0:1787603974.635762:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 85 00000100:00100000:3.0:1787603974.635774:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:10464:x1874438345763840:12345-192.168.202.21@tcp:34:lfs.0 00010000:00010000:3.0:1787603974.635865:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901a27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.635883:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901a27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.635895:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901a27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.635910:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901a2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.635918:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.635925:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636194:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636204:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636221:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787603974.636259:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636272:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901a27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636279:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901a27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636286:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901a27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636292:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603974.636296:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901a27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636317:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901a27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636329:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:3.0:1787603974.636332:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603974.636336:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901a27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636342:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901a27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636353:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636363:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901a2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636370:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901a2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636375:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603974.636378:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901a2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636383:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901a2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636390:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed290d35000) 00010000:00010000:3.0:1787603974.636393:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603974.636395:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901a2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636401:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901a2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636414:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636420:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636426:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636432:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603974.636440:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636447:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636455:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed290d35e00) 00010000:00010000:3.0:1787603974.636457:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603974.636459:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.636466:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603974.636538:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:10464:x1874438345763840:12345-192.168.202.21@tcp:34:lfs.0 Request processed in 765us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603974.636547:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 85 00000100:00100000:1.0:1787603974.637230:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 84 00000100:00100000:3.0:1787603974.718668:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603974.718764:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345764096 00000100:00100000:0.0:1787603974.718775:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345764096 00000100:00100000:0.0:1787603974.718854:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 86 00000100:00100000:0.0:1787603974.718865:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:10467:x1874438345764096:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603974.718884:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603974.718904:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901a3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b00 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.718976:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901a43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.718990:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901a43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719001:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901a43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719027:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719035:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719042:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719371:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901a51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719381:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719389:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603974.719398:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787603974.719488:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901a43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719496:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901a43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719502:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901a43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719508:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603974.719512:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901a43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719530:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901a43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719542:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:0.0:1787603974.719545:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603974.719550:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901a43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719555:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901a43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719567:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719573:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719579:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719584:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603974.719587:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719593:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719601:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed28870bd00) 00010000:00010000:0.0:1787603974.719604:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603974.719606:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719622:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719661:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901a3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b00 expref: 22 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719676:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901a51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b00 expref: 21 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.719684:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870b700) 00010000:00010000:0.0:1787603974.719686:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787603974.719688:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594200, rc 0) 00000100:00100000:0.0:1787603974.719757:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:10467:x1874438345764096:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 892us (1097us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787603974.719764:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 86 00000100:00100000:3.0:1787603974.741588:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603974.742261:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345764224 00000100:00100000:2.0:1787603974.742283:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345764224 00000100:00100000:2.0:1787603974.742340:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 87 00000100:00100000:2.0:1787603974.742351:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:10467:x1874438345764224:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:2.0:1787603974.742419:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a1901a5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.742437:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a1901a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.742449:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a1901a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.742475:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a1901a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.742482:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a1901a5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.742488:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a1901a5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.742504:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962a00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603974.742509:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a1901a5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.742517:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a1901a5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.742529:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870b700) 00010000:00010000:2.0:1787603974.742533:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787603974.742538:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a1901a5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603974.742544:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a1901a5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603974.742630:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:10467:x1874438345764224:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 281us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603974.742638:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 87 00000100:00100000:3.0:1787603974.746331:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603974.747780:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345764480 00000100:00100000:1.0:1787603974.747792:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345764480 00000100:00100000:1.0:1787603974.747865:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 21 00000100:00100000:1.0:1787603974.747876:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed291f93c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:10467:x1874438345764480:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:1.0:1787603974.748078:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed291f93c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:10467:x1874438345764480:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 204us (1756us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787603974.748087:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 21 00000100:00100000:0.0:1787603974.857329:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603974.857364:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345764736 00000100:00100000:0.0:1787603974.857375:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345764736 00000100:00100000:0.0:1787603974.857425:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 88 00000100:00100000:0.0:1787603974.857436:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:9995:x1874438345764736:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:0.0:1787603974.857459:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603974.857481:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901a66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b07 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.857593:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.857618:0:7875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901a51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b00 expref: 23 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.857626:0:7875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.857657:0:7875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901a51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b00 expref: 23 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.857669:0:7875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901a51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b00 expref: 23 pid: 7875 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603974.857681:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba254e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355222144:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603974.857775:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787603974.879731:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603974.879763:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345764864 00000100:00100000:0.0:1787603974.879771:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345764864 00010000:00010000:0.0:1787603974.879807:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901a51 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b00 expref: 24 pid: 7875 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603974.879855:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 47 00000100:00100000:0.0:1787603974.879864:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:2363:x1874438345764864:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787603974.879878:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603974.879885:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901a51 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b00 expref: 24 pid: 7875 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.879916:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901a51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b00 expref: 24 pid: 7875 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.879939:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870b700) 00010000:00010000:0.0:1787603974.879944:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.879954:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.879961:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603974.879979:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603974.880028:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:2363:x1874438345764864:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 164us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603974.880035:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 47 00010000:00010000:1.0:1787603974.881017:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901a51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b00 expref: 23 pid: 7875 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603974.881035:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba254e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355222144:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603974.881056:0:7875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.881064:0:7875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.881070:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603974.881104:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787603974.881257:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901a66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b07 expref: 24 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.881289:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b07 expref: 23 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.881297:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870b700) 00010000:00010000:1.0:1787603974.881300:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787603974.881303:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595200, rc 0) 00000100:00100000:1.0:1787603974.881341:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:9995:x1874438345764736:12345-192.168.202.21@tcp:101:bash.0 Request processed in 23906us (24019us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787603974.881349:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 88 00000100:00100000:0.0:1787603974.890583:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603974.892210:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345765120 00000100:00100000:3.0:1787603974.892222:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345765120 00000100:00100000:3.0:1787603974.892291:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 89 00000100:00100000:3.0:1787603974.892303:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:9995:x1874438345765120:12345-192.168.202.21@tcp:36:bash.0 00010000:00010000:3.0:1787603974.892558:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901a7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.892575:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.892586:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787603974.892731:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787603974.892758:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a0c566f reply state 00000000b9b1924b transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603974.892767:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787603974.892823:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787603974.892954:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+27:9995:x1874438345765120:12345-192.168.202.21@tcp:36:bash.0 Request processed in 653us (2379us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787603974.892961:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 89 00000020:00080000:3.0:1787603974.892966:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787603974.901586:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.901604:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901a7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.901612:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901a7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.901618:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603974.901624:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901a7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.901631:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901a7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.901648:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870b700) 00010000:00010000:3.0:1787603974.901651:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603974.901656:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901a7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.901679:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901a7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603974.901725:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603974.902621:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345765248 00000100:00100000:3.0:1787603974.902632:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345765248 00000100:00100000:3.0:1787603974.902699:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 90 00000100:00100000:3.0:1787603974.902720:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:9995:x1874438345765248:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:3.0:1787603974.902744:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603974.902761:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b0e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.902832:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b0e expref: 27 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.902863:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b0e expref: 27 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603974.902882:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870b700) 00010000:00010000:3.0:1787603974.902886:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787603974.902889:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad000, rc 0) 00000100:00100000:3.0:1787603974.902954:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+27:9995:x1874438345765248:12345-192.168.202.21@tcp:101:bash.0 Request processed in 245us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603974.902962:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 90 00000100:00100000:2.0:1787603974.906393:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603974.906469:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345765376 00000100:00100000:1.0:1787603974.906479:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345765376 00000100:00100000:1.0:1787603974.906535:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 33 00000100:00100000:1.0:1787603974.906545:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:9995:x1874438345765376:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:1.0:1787603974.906704:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603974.906736:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1901a89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b15 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787603974.906765:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8cac04, atime: 0x6a8cac02, ctime: 0x6a8cac04, blocks: 0xb 00010000:00010000:1.0:1787603974.906784:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=307s v=(0 0) 00010000:00010000:1.0:1787603974.906788:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603974.906796:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1901a89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b15 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.906812:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1901a89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b15 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603974.906873:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f400, rc 0) 00000100:00100000:1.0:1787603974.906936:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:9995:x1874438345765376:12345-192.168.202.21@tcp:101:bash.0 Request processed in 391us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603974.906942:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 33 00000100:00100000:2.0:1787603974.915635:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603974.915720:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345765504 00000100:00100000:0.0:1787603974.915729:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345765504 00002000:00010000:0.0:1787603974.915769:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787603974.915774:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2af73ce00 with x1874438345765504 ext(0->18446744073709551615) 00002000:00010000:0.0:1787603974.915785:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2af73ce00. 00000100:00100000:0.0:1787603974.915822:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1 00000100:00100000:0.0:1787603974.915831:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2366:x1874438345765504:12345-192.168.202.21@tcp:10:bash.0 00002000:00010000:0.0:1787603974.916136:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787603974.916141:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787603972 -> 1787603974 00002000:00010000:0.0:1787603974.916155:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787603970 -> 1787603970 00002000:00010000:0.0:1787603974.916157:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787603972 -> 1787603974 00002000:00010000:0.0:1787603974.916159:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787603974.916233:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2366:x1874438345765504:12345-192.168.202.21@tcp:10:bash.0 Request processed in 402us (605us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787603974.916241:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1 00002000:00010000:0.0:1787603974.916245:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787603974.916248:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2af73ce00 with x1874438345765504 ext(0->18446744073709551615) 00002000:00010000:0.0:1787603974.916252:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2af73ce00. 00000100:00100000:3.0:1787603975.064654:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603975.064769:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345765632 00000100:00100000:1.0:1787603975.064781:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345765632 00000100:00100000:1.0:1787603975.064869:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 91 00000100:00100000:1.0:1787603975.064879:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+27:10480:x1874438345765632:12345-192.168.202.21@tcp:34:lfs.0 00010000:00010000:1.0:1787603975.064954:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901a90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.064977:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.064991:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065007:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065014:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065020:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065311:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901a9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065330:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065337:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787603975.065375:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065508:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065514:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901a90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065521:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065526:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7ec00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603975.065530:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065536:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901a90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065556:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:1.0:1787603975.065559:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603975.065563:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065569:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065585:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065591:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901a97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065596:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065600:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603975.065602:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065607:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901a97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065614:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed291bd5500) 00010000:00010000:1.0:1787603975.065616:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603975.065618:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901a97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065622:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901a97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065633:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065637:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901a9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065642:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065650:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603975.065653:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065658:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901a9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065664:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870b700) 00010000:00010000:1.0:1787603975.065666:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603975.065668:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901a9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.065673:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901a9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603975.066122:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+27:10480:x1874438345765632:12345-192.168.202.21@tcp:34:lfs.0 Request processed in 1240us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603975.066133:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 91 00000100:00100000:2.0:1787603975.127794:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603975.127938:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345765888 00000100:00100000:3.0:1787603975.127949:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345765888 00000100:00100000:3.0:1787603975.128058:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 92 00000100:00100000:3.0:1787603975.128099:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+27:10484:x1874438345765888:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787603975.128119:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603975.128140:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901aa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b1c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.128217:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901aac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.128232:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.128244:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.128258:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.128265:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.128272:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.129758:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901aba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.129778:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.129787:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603975.129816:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787603975.129936:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.129944:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901aac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.129950:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.129955:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603975.129959:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.129966:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901aac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.129979:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:3.0:1787603975.129982:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603975.129986:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901aac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.129992:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901aac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.130005:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.130009:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.130022:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.130026:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603975.130029:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.130036:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.130043:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed290d35e00) 00010000:00010000:3.0:1787603975.130045:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603975.130048:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901ab3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.130052:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.131426:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901aa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b1c expref: 30 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.131448:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901aba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b1c expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.131457:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870b700) 00010000:00010000:3.0:1787603975.131460:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787603975.131463:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dadc00, rc 0) 00000100:00100000:3.0:1787603975.131913:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:10484:x1874438345765888:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 3820us (4126us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1787603975.131934:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 92 00000100:00100000:0.0:1787603975.136382:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603975.137695:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345766016 00000100:00100000:3.0:1787603975.137716:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345766016 00000100:00100000:3.0:1787603975.137768:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 93 00000100:00100000:3.0:1787603975.137777:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:10484:x1874438345766016:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:3.0:1787603975.137860:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.137878:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b07 expref: 29 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.137887:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.137919:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b07 expref: 29 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.137932:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b07 expref: 29 pid: 7875 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603975.137945:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1874438355222272:192.168.202.21@tcp:104: 00000100:00100000:3.0:1787603975.138348:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28670a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603975.149392:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603975.149510:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1874438355222272:192.168.202.21@tcp:104: 00010000:00010000:3.0:1787603975.149538:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603975.149776:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345766272 00000100:00100000:1.0:1787603975.149784:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345766272 00000100:00100000:1.0:1787603975.149857:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 22 00000100:00100000:1.0:1787603975.149866:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+30:5605:x1874438345766272:12345-192.168.202.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787603975.150767:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:5605:x1874438345766272:12345-192.168.202.21@tcp:35:ldlm_bl.0 Request processed in 897us (1381us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787603975.150778:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 22 00000100:00100000:1.0:1787603975.157169:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603975.157260:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345766400 00000100:00100000:0.0:1787603975.157279:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345766400 00010000:00010000:0.0:1787603975.157320:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b07 expref: 31 pid: 7875 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603975.157364:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 48 00000100:00100000:0.0:1787603975.157374:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:2364:x1874438345766400:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787603975.157390:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603975.157397:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b07 expref: 31 pid: 7875 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.157410:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b07 expref: 31 pid: 7875 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.157432:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901a6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b07 expref: 31 pid: 7875 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.157480:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870b700) 00010000:00010000:0.0:1787603975.157486:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.157496:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.157505:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.157540:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787603975.157698:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.157724:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.157756:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.157763:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.157770:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.157776:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603975.157780:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.157788:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.157797:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870b700) 00010000:00010000:3.0:1787603975.157800:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787603975.157803:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.157809:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901ac8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603975.157927:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+30:2364:x1874438345766400:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 553us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603975.157934:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 48 00000100:00100000:2.0:1787603975.166039:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:10484:x1874438345766016:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 28244us (29647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603975.166055:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 93 00000100:00100000:1.0:1787603975.169654:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603975.169740:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345766656 00000100:00100000:3.0:1787603975.169750:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345766656 00000100:00100000:3.0:1787603975.169806:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 23 00000100:00100000:3.0:1787603975.169816:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:10484:x1874438345766656:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:3.0:1787603975.170237:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+30:10484:x1874438345766656:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 421us (589us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787603975.170246:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 23 00000100:00100000:2.0:1787603975.308769:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603975.308991:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345766912 00000100:00100000:1.0:1787603975.309002:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345766912 00000100:00100000:1.0:1787603975.309104:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 94 00000100:00100000:1.0:1787603975.309115:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+30:10495:x1874438345766912:12345-192.168.202.21@tcp:101:cat.0 00010000:00010000:1.0:1787603975.309153:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603975.309173:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901acf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b23 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.309556:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901ad6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.309572:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.309584:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.309599:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901add lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.309605:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.309612:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.309958:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901ae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.309968:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.309976:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603975.309985:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787603975.310143:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310151:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901ad6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310157:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310163:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7ec00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603975.310167:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310174:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310187:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:1.0:1787603975.310190:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603975.310195:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901ad6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310452:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901ad6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310470:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310476:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901add lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310482:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310488:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603975.310498:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310504:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901add lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310512:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed291bd5500) 00010000:00010000:1.0:1787603975.310515:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603975.310517:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901add lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310523:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901add lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310568:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901acf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b23 expref: 33 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310582:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b23 expref: 32 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.310589:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870b700) 00010000:00010000:1.0:1787603975.310592:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787603975.310595:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f800, rc 0) 00000100:00100000:1.0:1787603975.310666:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:10495:x1874438345766912:12345-192.168.202.21@tcp:101:cat.0 Request processed in 1552us (1905us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787603975.310674:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 94 00000100:00100000:3.0:1787603975.316394:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603975.316593:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345767168 00000100:00100000:1.0:1787603975.316603:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345767168 00000100:00100000:1.0:1787603975.316654:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 24 00000100:00100000:1.0:1787603975.316663:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:10495:x1874438345767168:12345-192.168.202.21@tcp:35:cat.0 00000100:00100000:1.0:1787603975.316944:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+33:10495:x1874438345767168:12345-192.168.202.21@tcp:35:cat.0 Request processed in 281us (559us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787603975.316952:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 24 00000100:00100000:2.0:1787603975.377785:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603975.377926:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345767424 00000100:00100000:0.0:1787603975.377936:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345767424 00000100:00100000:0.0:1787603975.377999:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 95 00000100:00100000:0.0:1787603975.378011:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+33:10496:x1874438345767424:12345-192.168.202.21@tcp:36:rm.0 00010000:00010000:0.0:1787603975.378067:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787603975.378097:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901ae4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b23 expref: 33 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.378118:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901aba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b1c expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.378130:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901a82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b0e expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.378151:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870b700) 00010000:00010000:0.0:1787603975.378161:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787603975.378180:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901af2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.378192:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901af2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.378200:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901af2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.378212:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901af9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.378218:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901af9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.378224:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901af9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.378524:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901b00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.378532:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901b00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.378539:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901b00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787603975.379337:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787603975.379349:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 308443510918ns, next at 309443508196ns, rc = 0 00010000:00010000:0.0:1787603975.379416:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901b07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379427:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901b07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379435:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901b07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379441:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901b07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379447:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901b07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379454:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901b07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379480:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787603975.379501:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901b00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379508:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901b00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379514:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901b00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379520:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594a00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603975.379524:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901b00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379532:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901b00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379549:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870bf00) 00010000:00010000:0.0:1787603975.379552:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787603975.379556:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901b00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379562:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901b00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379578:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901af2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379585:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901af2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379591:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901af2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379596:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603975.379599:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901af2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379604:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901af2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379612:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:0.0:1787603975.379615:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603975.379618:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901af2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.379624:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901af2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787603975.379644:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9b3e437 reply state 0000000085506bd2 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901af9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603975.379652:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787603975.379744:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:10496:x1874438345767424:12345-192.168.202.21@tcp:36:rm.0 Request processed in 1733us (1965us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787603975.379752:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 95 00010000:00010000:3.0:1787603975.379994:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603975.380001:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901b07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.380008:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594600 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787603975.380011:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901b07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.380018:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901b07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.380027:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ed28870bf00) 00010000:00010000:3.0:1787603975.380030:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787603975.380033:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901b07 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.380038:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901b07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.380052:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603975.380054:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603975.380056:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603975.382797:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901af9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.382814:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901af9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.382833:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901af9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.382860:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603975.382866:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901af9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.382874:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901af9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.382889:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed28870bd00) 00010000:00010000:3.0:1787603975.382891:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603975.382895:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901af9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.382901:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901af9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603975.465151:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603975.465540:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345767680 00000100:00100000:3.0:1787603975.465552:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345767680 00000100:00100000:3.0:1787603975.465624:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 96 00000100:00100000:3.0:1787603975.465635:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:10502:x1874438345767680:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:3.0:1787603975.465658:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603975.465678:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901b0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b2a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.465811:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901b15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.465871:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901b15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.465883:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901b15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.465898:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.465905:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.465911:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787603975.466462:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787603975.466622:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901b23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.466633:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.466641:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.466678:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901b15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.466685:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901b15 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.466692:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901b15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.466716:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603975.466721:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901b15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.466728:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901b15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.466741:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:3.0:1787603975.466744:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603975.466749:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901b15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.466756:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901b15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787603975.466769:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003c3e034 reply state 0000000039753337 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603975.466778:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787603975.466807:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901b0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b2a expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.466820:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901b23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b2a expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.466827:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed290d35000) 00010000:00010000:3.0:1787603975.466830:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787603975.466832:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac800, rc 0) 00000100:00100000:3.0:1787603975.466947:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+34:10502:x1874438345767680:12345-192.168.202.21@tcp:101:bash.0 Request processed in 1313us (1806us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787603975.466961:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 96 00000100:00100000:2.0:1787603975.483015:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603975.483144:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345767808 00000100:00100000:1.0:1787603975.483155:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345767808 00000100:00100000:1.0:1787603975.483237:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 34 00000100:00100000:1.0:1787603975.483258:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2366:x1874438345767808:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:1.0:1787603975.483284:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603975.483308:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b31 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787603975.483336:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787603975.483356:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=308s v=(0 0) 00010000:00010000:1.0:1787603975.483362:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603975.483372:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b31 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.483392:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b31 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.483407:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f000, rc 0) 00000100:00100000:1.0:1787603975.483471:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2366:x1874438345767808:12345-192.168.202.21@tcp:101:bash.0 Request processed in 223us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603975.483478:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 34 00000100:00080000:2.0:1787603975.484143:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787603975.484486:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.484497:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.484504:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.484510:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603975.484515:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.484524:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.484539:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed290d35e00) 00010000:00010000:3.0:1787603975.484542:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603975.484547:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.484553:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603975.487666:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603975.487958:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345767936 00000100:00100000:1.0:1787603975.487994:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345767936 00000100:00100000:1.0:1787603975.488052:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 35 00000100:00100000:1.0:1787603975.488073:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:10502:x1874438345767936:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:1.0:1787603975.488090:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603975.488109:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b38 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.488139:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b31 expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.488148:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603975.488153:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603975.488158:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.488194:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b31 expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.488208:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b31 expref: 9 pid: 6676 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603975.488222:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874438355222400:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787603975.488600:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286784900 going to sleep for 11 seconds 00000100:00100000:2.0:1787603975.498745:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874438355222400:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787603975.498782:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603975.498805:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7ec00, rc 0) 00000100:00100000:2.0:1787603975.498880:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:10502:x1874438345767936:12345-192.168.202.21@tcp:101:bash.0 Request processed in 10809us (11222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603975.498890:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 35 00000100:00100000:0.0:1787603975.503779:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603975.505805:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345768064 00000100:00100000:2.0:1787603975.505820:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345768064 00010000:00010000:2.0:1787603975.505917:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b31 expref: 9 pid: 6676 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603975.505955:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 49 00000100:00100000:2.0:1787603975.505965:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa48f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2364:x1874438345768064:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603975.505990:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603975.506015:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b31 expref: 9 pid: 6676 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603975.506030:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b31 expref: 9 pid: 6676 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603975.506084:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b31 expref: 9 pid: 6676 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603975.506101:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787603975.506107:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787603975.506115:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603975.506126:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603975.506166:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603975.506180:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b74000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1874438355222528:192.168.202.21@tcp:105: 00000100:00100000:2.0:1787603975.506284:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b4971240 going to sleep for 11 seconds 00000100:00100000:3.0:1787603975.510447:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603975.510603:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b74000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1874438355222528:192.168.202.21@tcp:105: 00010000:00010000:2.0:1787603975.510627:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603975.510689:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa48f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2364:x1874438345768064:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 4724us (6919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603975.510699:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 49 00000100:00100000:1.0:1787603975.511150:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345768320 00000100:00100000:1.0:1787603975.511158:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345768320 00000100:00100000:1.0:1787603975.511197:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 25 00000100:00100000:1.0:1787603975.511206:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+33:10502:x1874438345768320:12345-192.168.202.21@tcp:35:bash.0 00000100:00100000:1.0:1787603975.511552:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+34:10502:x1874438345768320:12345-192.168.202.21@tcp:35:bash.0 Request processed in 347us (1124us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787603975.511560:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 25 00010000:00010000:1.0:1787603975.575331:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603975.809774:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603975.809887:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345768448 00000100:00100000:0.0:1787603975.809898:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345768448 00000100:00100000:0.0:1787603975.809964:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 97 00000100:00100000:0.0:1787603975.809974:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+34:10518:x1874438345768448:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603975.810002:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603975.810023:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901b3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b3f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.810102:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901b46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.810117:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.810128:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603975.810188:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787603975.810193:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787603975.810243:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.810268:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901b3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b3f expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.810288:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b3f expref: 35 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.810297:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:0.0:1787603975.810300:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787603975.810303:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595e00, rc 0) 00000100:00100000:0.0:1787603975.810367:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+35:10518:x1874438345768448:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 393us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603975.810374:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 97 00000100:00100000:2.0:1787603975.815554:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603975.815780:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345768704 00000100:00100000:3.0:1787603975.815792:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345768704 00000100:00100000:3.0:1787603975.815871:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 98 00000100:00100000:3.0:1787603975.815894:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+35:10518:x1874438345768704:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787603975.815913:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603975.815933:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901b4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b46 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.816028:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.816041:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.816050:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603975.816061:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787603975.816196:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901b4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b46 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.816225:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b46 expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.816234:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed290d35000) 00010000:00010000:3.0:1787603975.816237:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787603975.816241:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad200, rc 0) 00000100:00100000:3.0:1787603975.816691:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:10518:x1874438345768704:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 797us (1145us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787603975.816699:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 98 00000100:00100000:3.0:1787603975.820678:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603975.820788:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345768960 00000100:00100000:1.0:1787603975.820799:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345768960 00000100:00100000:1.0:1787603975.820897:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:1.0:1787603975.820908:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:2364:x1874438345768960:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603975.820924:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603975.820949:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901b54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b46 expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.820968:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed290d35000) 00010000:00010000:1.0:1787603975.820973:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603975.821032:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+36:2364:x1874438345768960:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 125us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603975.821039:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:0.0:1787603975.826770:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603975.826882:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345769088 00000100:00100000:1.0:1787603975.826893:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345769088 00000100:00100000:1.0:1787603975.826949:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 99 00000100:00100000:1.0:1787603975.826959:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+36:10518:x1874438345769088:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787603975.826983:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603975.827005:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901b62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b4d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.827120:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901b69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.827145:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901b69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.827157:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901b69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603975.827171:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787603975.827302:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901b62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b4d expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.827321:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901b69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b4d expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.827330:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed290d35000) 00010000:00010000:1.0:1787603975.827333:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787603975.827336:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e400, rc 0) 00000100:00100000:1.0:1787603975.827389:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+38:10518:x1874438345769088:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 431us (628us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787603975.827396:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 99 00000100:00100000:3.0:1787603975.838915:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603975.839015:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345769216 00000100:00100000:1.0:1787603975.839026:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345769216 00000100:00100000:1.0:1787603975.839086:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 36 00000100:00100000:1.0:1787603975.839097:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2366:x1874438345769216:12345-192.168.202.21@tcp:1:lfs.0 00010000:00010000:1.0:1787603975.839140:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.839161:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.839176:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603975.839180:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787603975.839185:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.839233:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.839246:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 8 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603975.839261:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1874438355222656:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787603975.839351:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787603975.846463:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1874438355222656:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603975.846487:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603975.851522:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603975.852050:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345769344 00000100:00100000:0.0:1787603975.852059:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345769344 00002000:00100000:0.0:1787603975.852108:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ed2b4bd8e00 x1874438345769344/t0(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:301/0 lens 504/0 e 0 to 0 dl 1787603986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787603975.852119:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2b4bd8e00 with x1874438345769344 ext(0->8) 00010000:00010000:0.0:1787603975.852127:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 9 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.852142:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 9 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787603975.852150:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed2b4bd8e00 00000100:00100000:0.0:1787603975.852279:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1 00000100:00100000:0.0:1787603975.852289:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2363:x1874438345769344:12345-192.168.202.21@tcp:4:lfs.0 00000100:00100000:0.0:1787603975.852792:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:2363:x1874438345769344:12345-192.168.202.21@tcp:4:lfs.0 Request processed in 504us (1278us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787603975.852800:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1 00002000:00100000:0.0:1787603975.852808:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ed2b4bd8e00 x1874438345769344/t4294967302(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:301/0 lens 504/448 e 0 to 0 dl 1787603986 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787603975.852817:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2b4bd8e00 with x1874438345769344 ext(0->8) 00010000:00010000:0.0:1787603975.852824:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 11 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.852835:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 11 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787603975.852879:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed2b4bd8e00 00000100:00100000:0.0:1787603975.864391:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603975.865140:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345769472 00000100:00100000:3.0:1787603975.865150:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345769472 00010000:00010000:3.0:1787603975.865191:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 11 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603975.865237:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 50 00000100:00100000:3.0:1787603975.865248:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:2364:x1874438345769472:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787603975.865263:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787603975.865283:0:5806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787603975.865287:0:5806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787603975 00002000:00010000:3.0:1787603975.865289:0:5806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787603975 00002000:00010000:3.0:1787603975.865291:0:5806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787603975 00010000:00010000:3.0:1787603975.865297:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 11 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.865312:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 11 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.865335:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1901b38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b38 expref: 11 pid: 6679 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.865352:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787603975.865357:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787603975.865362:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.865395:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603975.865734:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603975.865795:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:2364:x1874438345769472:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 549us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603975.865803:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 50 00010000:00010000:1.0:1787603975.874829:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.874871:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.874912:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.874937:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.874945:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.874953:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f000 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787603975.874958:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.874967:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.875274:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.875283:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1901b77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603975.875393:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2366:x1874438345769216:12345-192.168.202.21@tcp:1:lfs.0 Request processed in 36293us (36482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603975.875403:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 36 00000100:00100000:0.0:1787603975.879627:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603975.880368:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345769728 00000100:00100000:3.0:1787603975.880380:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345769728 00000100:00100000:3.0:1787603975.880443:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 26 00000100:00100000:3.0:1787603975.880454:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed291f91850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+38:10518:x1874438345769728:12345-192.168.202.21@tcp:35:lfs.0 00000004:00010000:3.0:1787603975.880525:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901b69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b4d expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787603975.880881:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787603975.880927:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787603975.882822:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1787603975.883735:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603975.883769:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901b23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b2a expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603975.883778:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603975.883818:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901b23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b2a expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603975.883862:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901b23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b2a expref: 42 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603975.883877:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b77800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1874438355222784:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787603975.884168:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b4971e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787603975.887317:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603975.887430:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345769856 00000100:00100000:1.0:1787603975.887445:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345769856 00010000:00010000:1.0:1787603975.887481:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901b23 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b2a expref: 43 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603975.887524:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 51 00000100:00100000:1.0:1787603975.887533:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+43:2364:x1874438345769856:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603975.887558:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603975.887565:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901b23 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b2a expref: 43 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.887576:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901b23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b2a expref: 43 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.887598:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed290d35000) 00010000:00010000:1.0:1787603975.887603:0:6693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.887612:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.887619:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.887637:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603975.887694:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+43:2364:x1874438345769856:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 161us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603975.887710:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 51 00010000:00010000:2.0:1787603975.889184:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901b23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b2a expref: 42 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603975.889205:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b77800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1874438355222784:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787603975.889228:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603975.889238:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603975.889244:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787603975.889367:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787603975.890327:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787603975.890471:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b77800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1874438355222912:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787603975.890534:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603975.890578:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2a122f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787603975.891006:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355222912 00000100:00100000:3.0:1787603975.891014:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355222912 00000100:00100000:0.0:1787603975.891573:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787603975.891583:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5825:x1874438355222912:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787603975.891676:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5825:x1874438355222912:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603975.891683:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787603975.891735:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b77800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1874438355222912:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1787603975.892168:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787603975.893335:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787603975.893422:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba256d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1874438355223040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787603975.894374:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603975.894414:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c6900 going to sleep for 11 seconds 00000100:00100000:2.0:1787603975.895039:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355223040 00000100:00100000:2.0:1787603975.895049:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355223040 00000100:00100000:2.0:1787603975.895114:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787603975.895126:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5825:x1874438355223040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787603975.895333:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5825:x1874438355223040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 209us (958us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787603975.895341:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787603975.895421:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba256d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1874438355223040:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787603975.895492:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787603975.895529:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.895540:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.895558:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.895564:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603975.895568:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.895575:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.895589:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed290d35000) 00010000:00010000:0.0:1787603975.895592:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787603975.895596:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603975.895602:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901b7e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787603975.895776:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787603975.896279:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1787603975.896292:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 308960454445ns, next at 309960452017ns, rc = 0 00000001:00080000:0.0:1787603975.896313:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787603975.896354:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed290d35000) 00010000:00010000:0.0:1787603975.896357:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787603975.896365:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901b69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b4d expref: 46 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603975.896471:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed291f91850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+45:10518:x1874438345769728:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 16019us (16854us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787603975.896480:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 26 00000020:00080000:0.0:1787603975.896484:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787603975.901151:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603975.901235:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345769984 00000100:00100000:1.0:1787603975.901244:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345769984 00000100:00100000:1.0:1787603975.901298:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 100 00000100:00100000:1.0:1787603975.901316:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+45:10518:x1874438345769984:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787603975.901341:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603975.901364:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901b85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b54 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.901423:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901b85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b54 expref: 46 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.901449:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901b85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b54 expref: 46 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603975.901470:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:1.0:1787603975.901473:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787603975.901477:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f000, rc 0) 00000100:00100000:1.0:1787603975.901538:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+46:10518:x1874438345769984:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 224us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603975.901553:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 100 00000100:00100000:3.0:1787603975.910497:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603975.910658:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345770240 00000100:00100000:1.0:1787603975.910669:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345770240 00000100:00100000:1.0:1787603975.910763:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 27 00000100:00100000:1.0:1787603975.910774:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+46:10518:x1874438345770240:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:1.0:1787603975.911057:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+47:10518:x1874438345770240:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 284us (568us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1787603975.911064:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 27 00000100:00100000:0.0:1787603975.978899:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603975.978935:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603975.979128:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345770496 00000100:00100000:2.0:1787603975.979138:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345770496 00000100:00100000:2.0:1787603975.979212:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 57 00000100:00100000:2.0:1787603975.979224:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2366:x1874438345770496:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603975.979293:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2366:x1874438345770496:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 71us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603975.979299:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 57 00000100:00080000:3.0:1787603975.979365:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787603975.979786:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345770368 00000100:00100000:1.0:1787603975.979791:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345770368 00000100:00100000:1.0:1787603975.979830:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 287 00000100:00100000:1.0:1787603975.979878:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345770368:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603975.979910:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345770368:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 34us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603975.979916:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 287 00000100:00100000:0.0:1787603975.985776:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603975.985933:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345770624 00000100:00100000:1.0:1787603975.985943:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345770624 00000100:00080000:3.0:1787603975.986193:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603975.986240:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 134 00000100:00100000:1.0:1787603975.986252:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345770624:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603975.986332:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345770624:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 83us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603975.986340:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 134 00000100:00100000:3.0:1787603976.032452:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603976.032658:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345770752 00000100:00100000:1.0:1787603976.032669:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345770752 00000100:00100000:1.0:1787603976.032759:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 101 00000100:00100000:1.0:1787603976.032770:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+47:10528:x1874438345770752:12345-192.168.202.21@tcp:34:lfs.0 00010000:00010000:1.0:1787603976.032879:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901b8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.032895:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.032907:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.032922:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901b93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.032930:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.032950:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787603976.033164:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787603976.033226:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901b9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033236:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033244:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787603976.033285:0:7875:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033297:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033303:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901b8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033310:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033316:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603976.033321:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033328:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901b8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033339:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:1.0:1787603976.033348:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603976.033353:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901b8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033359:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901b8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033373:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033378:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901b93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033383:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033388:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603976.033391:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033396:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901b93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033404:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed291bd5e00) 00010000:00010000:1.0:1787603976.033407:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603976.033410:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901b93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033415:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901b93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033427:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033823:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901b9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033829:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901b9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033834:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603976.033874:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901b9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033881:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901b9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033890:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:1.0:1787603976.033893:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603976.033895:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901b9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.033901:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901b9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603976.033990:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+47:10528:x1874438345770752:12345-192.168.202.21@tcp:34:lfs.0 Request processed in 1221us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603976.033999:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 101 00000100:00100000:3.0:1787603976.098258:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603976.098416:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345771008 00000100:00100000:2.0:1787603976.098427:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345771008 00000100:00100000:2.0:1787603976.098499:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 102 00000100:00100000:2.0:1787603976.098510:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+47:10531:x1874438345771008:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:2.0:1787603976.098529:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603976.098561:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901ba1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b5b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603976.098635:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901ba8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603976.098665:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603976.098676:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603976.098691:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901baf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603976.098698:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603976.098737:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.099379:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901bb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.099398:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.099407:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603976.099418:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787603976.100230:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100242:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901ba8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100249:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100255:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603976.100260:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100268:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901ba8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100281:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:3.0:1787603976.100284:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603976.100289:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901ba8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100295:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1901ba8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100309:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100324:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901baf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100330:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901baf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100334:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603976.100337:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901baf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100344:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901baf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100352:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed2b2e8b300) 00010000:00010000:3.0:1787603976.100354:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603976.100357:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901baf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100363:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1901baf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100410:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901ba1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b5b expref: 50 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.100425:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b5b expref: 49 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.101643:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:3.0:1787603976.101647:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787603976.101663:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac200, rc 0) 00000100:00100000:3.0:1787603976.101759:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10531:x1874438345771008:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 3249us (3509us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787603976.101768:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 102 00000100:00100000:3.0:1787603976.105863:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603976.105938:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345771136 00000100:00100000:0.0:1787603976.105948:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345771136 00000100:00100000:0.0:1787603976.106391:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 103 00000100:00100000:0.0:1787603976.106403:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10531:x1874438345771136:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:0.0:1787603976.106482:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901bc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.106499:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.106510:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.106535:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.106553:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901bc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.106573:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.106580:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603976.106584:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.106592:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901bc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.106604:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:0.0:1787603976.106608:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787603976.106612:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901bc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.106618:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901bc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603976.106696:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10531:x1874438345771136:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 296us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603976.106715:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 103 00000100:00100000:1.0:1787603976.114091:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603976.114235:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345771392 00000100:00100000:0.0:1787603976.114245:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345771392 00000100:00100000:0.0:1787603976.114300:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 28 00000100:00100000:0.0:1787603976.114310:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:10531:x1874438345771392:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:0.0:1787603976.114600:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:10531:x1874438345771392:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 290us (518us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787603976.114609:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 28 00000001:00080000:2.0:1787603976.200174:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1787603976.200362:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:2.0:1787603976.200499:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1787603976.304473:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603976.309433:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345771648 00000100:00100000:1.0:1787603976.309449:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345771648 00000100:00100000:1.0:1787603976.309531:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 104 00000100:00100000:1.0:1787603976.309551:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:10541:x1874438345771648:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:1.0:1787603976.309598:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603976.309602:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787603976.309631:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901b46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b3f expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.309653:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:1.0:1787603976.309659:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787603976.309672:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901bcb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b62 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.309803:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901bd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.309816:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.309826:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603976.309871:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787603976.310004:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901bcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b62 expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.310022:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b62 expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.310031:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:1.0:1787603976.310034:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787603976.310037:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e600, rc 0) 00000100:00100000:1.0:1787603976.310298:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:10541:x1874438345771648:12345-192.168.202.21@tcp:101:bash.0 Request processed in 748us (5844us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787603976.310306:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 104 00000100:00100000:0.0:1787603976.316978:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603976.324826:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345771904 00000100:00100000:1.0:1787603976.324863:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345771904 00000100:00100000:1.0:1787603976.324939:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 105 00000100:00100000:1.0:1787603976.324950:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:10541:x1874438345771904:12345-192.168.202.21@tcp:36:bash.0 00010000:00010000:1.0:1787603976.325010:0:7875:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787603976.325033:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901bd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b62 expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.325058:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901bb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b5b expref: 50 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.325069:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:1.0:1787603976.325073:0:7875:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787603976.325279:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1901be0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.325292:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1901be0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.325300:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1901be0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787603976.325349:0:7875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1787603976.325371:0:7875:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008dad4238 reply state 00000000ca979cc6 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1901be0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603976.325397:0:7875:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787603976.326923:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:10541:x1874438345771904:12345-192.168.202.21@tcp:36:bash.0 Request processed in 1967us (9947us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787603976.326933:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 105 00000020:00080000:1.0:1787603976.326940:0:7875:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787603976.338141:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1901be0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.338159:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1901be0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.338166:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1901be0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.338172:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fa00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603976.338177:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1901be0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.338184:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1901be0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.338202:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:3.0:1787603976.338205:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603976.338210:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1901be0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.338215:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1901be0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603976.342218:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603976.342307:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345772032 00000100:00100000:1.0:1787603976.342316:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345772032 00000100:00100000:1.0:1787603976.342371:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 106 00000100:00100000:1.0:1787603976.342382:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:10541:x1874438345772032:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:1.0:1787603976.342405:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603976.342426:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901be7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b69 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.342517:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901bee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.342549:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.342560:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603976.342601:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787603976.342605:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787603976.342625:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.342650:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901be7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b69 expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.342686:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b69 expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.342711:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:1.0:1787603976.342715:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787603976.342718:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7ee00, rc 0) 00000100:00100000:1.0:1787603976.342774:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:10541:x1874438345772032:12345-192.168.202.21@tcp:101:bash.0 Request processed in 393us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603976.342781:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 106 00000100:00100000:2.0:1787603976.349806:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603976.350492:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345772288 00000100:00100000:1.0:1787603976.350503:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345772288 00000100:00100000:1.0:1787603976.350762:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 29 00000100:00100000:1.0:1787603976.350775:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:10541:x1874438345772288:12345-192.168.202.21@tcp:35:bash.0 00000100:00100000:1.0:1787603976.351187:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+53:10541:x1874438345772288:12345-192.168.202.21@tcp:35:bash.0 Request processed in 414us (1390us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787603976.351196:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 29 00000100:00100000:2.0:1787603976.474990:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603976.475201:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345772416 00000100:00100000:0.0:1787603976.475212:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345772416 00000100:00100000:0.0:1787603976.475275:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 107 00000100:00100000:0.0:1787603976.475285:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+53:10547:x1874438345772416:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603976.475308:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603976.475327:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901bf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b70 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.475386:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901bfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.475399:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.475410:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603976.475468:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787603976.475472:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787603976.475493:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.475518:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901bf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b70 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.475550:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901bfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b70 expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.475577:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:0.0:1787603976.475580:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787603976.475584:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594400, rc 0) 00000100:00100000:0.0:1787603976.475642:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:10547:x1874438345772416:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 359us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603976.475650:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 107 00000100:00100000:2.0:1787603976.479775:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603976.479879:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345772544 00000100:00100000:1.0:1787603976.479889:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345772544 00000100:00100000:1.0:1787603976.479947:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 108 00000100:00100000:1.0:1787603976.479958:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:10547:x1874438345772544:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787603976.479978:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603976.479998:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b77 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.480072:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.480099:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.480110:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.480125:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.480131:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.480137:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481168:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901c18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481182:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481191:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603976.481663:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787603976.481669:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787603976.481687:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481711:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481734:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481741:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481747:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481753:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603976.481757:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481764:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481777:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:1.0:1787603976.481781:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603976.481785:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481791:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481803:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481809:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481816:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481827:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fe00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603976.481830:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481854:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481864:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed291bd5e00) 00010000:00010000:1.0:1787603976.481867:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603976.481869:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481874:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481909:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b77 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481922:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901c18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b77 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.481929:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:1.0:1787603976.481931:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787603976.481934:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7fc00, rc 0) 00000100:00100000:1.0:1787603976.482110:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10547:x1874438345772544:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 2153us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603976.482118:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 108 00000100:00100000:2.0:1787603976.499968:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603976.500175:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345772672 00000100:00100000:0.0:1787603976.500186:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345772672 00000100:00100000:0.0:1787603976.500265:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:0.0:1787603976.500276:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:2364:x1874438345772672:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787603976.500292:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603976.500317:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901c18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b77 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.500337:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:0.0:1787603976.500342:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603976.500398:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:2364:x1874438345772672:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 123us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603976.500406:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:2.0:1787603976.505796:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603976.506249:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345772928 00000100:00100000:0.0:1787603976.506259:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345772928 00000100:00100000:0.0:1787603976.506310:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 109 00000100:00100000:0.0:1787603976.506320:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:10547:x1874438345772928:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603976.506341:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603976.506360:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901c1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b7e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.506485:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.506501:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901bee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b69 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.506509:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.506542:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b69 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603976.506556:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b69 expref: 55 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603976.506569:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355223168:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603976.506859:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603976.526260:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603976.526389:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355223168:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603976.526418:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603976.526648:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345773056 00000100:00100000:1.0:1787603976.526669:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345773056 00010000:00010000:1.0:1787603976.526713:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b69 expref: 56 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603976.526751:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 52 00000100:00100000:1.0:1787603976.526761:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:2364:x1874438345773056:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603976.526790:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603976.526799:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b69 expref: 56 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.526811:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b69 expref: 56 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.526834:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901bee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b69 expref: 56 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.526888:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:1.0:1787603976.526893:0:6693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.526902:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.526910:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.526940:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603976.526985:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:2364:x1874438345773056:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 225us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603976.527002:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 52 00010000:00010000:3.0:1787603976.527173:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.527192:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603976.527223:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787603976.527373:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901c1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b7e expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.527389:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b7e expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.527397:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:3.0:1787603976.527400:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787603976.527402:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594800, rc 0) 00000100:00100000:3.0:1787603976.527428:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10547:x1874438345772928:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 21111us (21643us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787603976.527436:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 109 00000100:00100000:0.0:1787603976.544562:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603976.548406:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345773312 00000100:00100000:2.0:1787603976.548422:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345773312 00000100:00100000:2.0:1787603976.548516:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:2.0:1787603976.548527:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10547:x1874438345773312:12345-192.168.202.21@tcp:103:lfs.0 00010000:00010000:2.0:1787603976.548543:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603976.548589:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901b85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b54 expref: 55 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603976.548609:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:2.0:1787603976.548614:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603976.548686:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:10547:x1874438345773312:12345-192.168.202.21@tcp:103:lfs.0 Request processed in 160us (4134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603976.548694:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:2.0:1787603976.552745:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603976.552903:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345773440 00000100:00100000:3.0:1787603976.552913:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345773440 00000100:00100000:3.0:1787603976.552977:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 110 00000100:00100000:3.0:1787603976.552989:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:10547:x1874438345773440:12345-192.168.202.21@tcp:58:lfs.0 00010000:00010000:3.0:1787603976.553093:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901c34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.553110:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901c34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603976.553120:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901c34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787603976.553380:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787603976.553464:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:10547:x1874438345773440:12345-192.168.202.21@tcp:58:lfs.0 Request processed in 477us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603976.553473:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 110 00000100:00100000:0.0:1787603976.564023:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603976.564177:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345773568 00000100:00100000:1.0:1787603976.564187:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345773568 00000100:00100000:1.0:1787603976.564244:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 111 00000100:00100000:1.0:1787603976.564255:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:10547:x1874438345773568:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787603976.564274:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603976.564294:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901c3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b85 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.564348:0:7875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901c34 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.564359:0:7875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901c3b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b85 expref: 55 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.564377:0:7875:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901c34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.564389:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901c3b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b85 expref: 55 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.564402:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:1.0:1787603976.564405:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787603976.564409:0:7875:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901c3b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b85 expref: 55 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603976.564418:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7ee00, rc 0) 00000100:00100000:1.0:1787603976.564505:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10547:x1874438345773568:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 251us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603976.564512:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 111 00010000:00010000:1.0:1787603976.601135:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787603977.367461:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787603977.367470:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787603977.367507:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787603977.367513:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787603977.367640:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874438355223296:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787603977.367760:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2986fb480 going to sleep for 11 seconds 00000100:00100000:1.0:1787603977.371002:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874438355223296:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787603977.372511:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603977.372789:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345773696 00000100:00100000:3.0:1787603977.372798:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345773696 00000100:00100000:3.0:1787603977.372884:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 112 00000100:00100000:3.0:1787603977.372895:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10548:x1874438345773696:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787603977.372933:0:5821:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787603977.373038:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10548:x1874438345773696:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 Request processed in 144us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603977.373167:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 112 00000100:00100000:0.0:1787603977.385329:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603977.385603:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345773824 00000100:00100000:1.0:1787603977.385614:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345773824 00000100:00100000:1.0:1787603977.385674:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 113 00000100:00100000:1.0:1787603977.385685:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10548:x1874438345773824:12345-192.168.202.21@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787603977.385768:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c42 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.385785:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.385798:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.385867:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.385875:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.385900:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.385934:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.385944:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.385951:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603977.385992:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787603977.385997:0:7875:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787603977.386009:0:7875:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386020:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386027:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c42 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386033:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386040:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603977.386226:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386234:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c42 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386252:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed290d35200) 00010000:00010000:1.0:1787603977.386255:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603977.386259:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386265:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386331:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386337:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c49 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386343:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386348:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fe00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603977.386350:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386356:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c49 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386362:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9ed291bd5e00) 00010000:00010000:1.0:1787603977.386364:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603977.386367:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c49 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386372:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c49 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386396:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386401:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386406:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386410:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603977.386413:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386487:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386496:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:1.0:1787603977.386499:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603977.386502:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.386508:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603977.387029:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10548:x1874438345773824:12345-192.168.202.21@tcp:34:lhsmtool_posix.0 Request processed in 1342us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603977.387039:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 113 00000100:00100000:0.0:1787603977.397195:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603977.397453:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345774080 00000100:00100000:3.0:1787603977.397464:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345774080 00000100:00100000:3.0:1787603977.397523:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 114 00000100:00100000:3.0:1787603977.397533:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:10548:x1874438345774080:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787603977.397555:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603977.397589:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901c57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b8c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.397700:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901c5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.397714:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.397725:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603977.397754:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787603977.397893:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.397901:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901c5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.398380:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901c5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.398391:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603977.398397:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901c5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.398404:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901c5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.398416:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:3.0:1787603977.398419:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787603977.398424:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901c5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.398430:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901c5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.398474:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901c57 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b8c expref: 57 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.398484:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed290d35200) 00010000:00010000:3.0:1787603977.398487:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787603977.398500:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901c57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b8c expref: 57 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.398511:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac200, rc 0) 00000100:00100000:3.0:1787603977.398676:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:10548:x1874438345774080:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 1142us (1488us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1787603977.398685:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 114 00000100:00100000:2.0:1787603977.415950:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603977.417263:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345774208 00000100:00100000:3.0:1787603977.417283:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345774208 00000100:00100000:3.0:1787603977.417387:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 115 00000100:00100000:3.0:1787603977.417401:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:10548:x1874438345774208:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787603977.417494:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787603977.417764:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:10548:x1874438345774208:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 Request processed in 356us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603977.417801:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 115 00000100:00100000:2.0:1787603977.442781:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603977.446523:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345774464 00000100:00100000:1.0:1787603977.446548:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345774464 00000100:00100000:1.0:1787603977.446642:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 116 00000100:00100000:1.0:1787603977.446669:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:10548:x1874438345774464:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787603977.446699:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603977.446703:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787603977.446729:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901bfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b70 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.446750:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:1.0:1787603977.446756:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787603977.446769:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b93 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787603977.447230:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787603977.447426:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.447440:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.447457:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.447507:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b93 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.447523:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b93 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.447530:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5e00) 00010000:00010000:1.0:1787603977.447533:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787603977.447546:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7fe00, rc 0) 00000100:00100000:1.0:1787603977.447625:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+57:10548:x1874438345774464:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 960us (4853us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787603977.447633:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 116 00000100:00100000:2.0:1787603977.455365:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603977.455442:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345774720 00000100:00100000:1.0:1787603977.455453:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345774720 00000100:00100000:1.0:1787603977.455515:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 117 00000100:00100000:1.0:1787603977.455526:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+57:10548:x1874438345774720:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787603977.455622:0:7875:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603977.455670:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901c73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b93 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455699:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5e00) 00010000:00010000:1.0:1787603977.455711:0:7875:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787603977.455733:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455747:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455757:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455770:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901c88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2c034267 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455778:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c034267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455784:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c034267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455899:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455918:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455925:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455930:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603977.455934:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455941:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455950:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:1.0:1787603977.455953:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603977.455956:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455961:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901c81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455971:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c034267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455977:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901c88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c034267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455982:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901c88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c034267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.455993:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603977.455996:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901c88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c034267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.456002:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901c88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c034267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.456011:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2c034267 (ffff9ed291bd5100) 00010000:00010000:1.0:1787603977.456013:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603977.456016:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901c88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2c034267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.456022:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901c88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2c034267 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603977.456265:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:10548:x1874438345774720:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 740us (909us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787603977.456273:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 117 00000100:00100000:2.0:1787603977.462595:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603977.463086:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345774848 00000100:00100000:1.0:1787603977.463096:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345774848 00000100:00100000:1.0:1787603977.463155:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 118 00000100:00100000:1.0:1787603977.463165:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:10548:x1874438345774848:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787603977.463186:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603977.463210:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5b9a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.463251:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901c96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.463301:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.463313:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.463420:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b9a expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.463439:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b9a expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.463448:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:1.0:1787603977.463452:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787603977.463456:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f000, rc 0) 00000100:00100000:1.0:1787603977.463521:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+57:10548:x1874438345774848:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 357us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603977.463529:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 118 00000100:00100000:3.0:1787603977.483790:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603977.486400:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345775104 00000100:00100000:1.0:1787603977.486417:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345775104 00000100:00100000:1.0:1787603977.486702:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 119 00000100:00100000:1.0:1787603977.486713:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+57:10548:x1874438345775104:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787603977.487192:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.487211:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.487242:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787603977.487744:0:7875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1787603977.487833:0:7875:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310551995462ns, next at 311551992535ns, rc = 0 00000004:00010000:2.0:1787603977.498803:0:7875:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f858821 reply state 00000000335811cb transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603977.498823:0:7875:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787603977.498999:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:10548:x1874438345775104:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 12283us (15214us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787603977.499017:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 119 00000100:00100000:2.0:1787603977.506948:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1787603977.507627:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.507641:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.507649:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.507655:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603977.507660:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.507667:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.507683:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603977.507710:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787603977.507716:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.507722:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901c9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603977.508875:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345775232 00000100:00100000:0.0:1787603977.508890:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345775232 00000100:00100000:0.0:1787603977.508943:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 120 00000100:00100000:0.0:1787603977.508954:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+58:10548:x1874438345775232:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787603977.508979:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603977.508996:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ca4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ba1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.509067:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ca4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ba1 expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.509081:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ca4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ba1 expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.509102:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:0.0:1787603977.509105:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787603977.509108:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594200, rc 0) 00000100:00100000:0.0:1787603977.509171:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:10548:x1874438345775232:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 218us (2231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603977.509179:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 120 00000100:00100000:0.0:1787603977.513319:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603977.513388:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345775360 00000100:00100000:3.0:1787603977.513397:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345775360 00000100:00100000:3.0:1787603977.513477:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 37 00000100:00100000:3.0:1787603977.513488:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2364:x1874438345775360:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787603977.513769:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787603977.514180:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2364:x1874438345775360:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 Request processed in 555us (730us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787603977.514189:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 37 00000100:00100000:3.0:1787603977.518119:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603977.518223:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345775616 00000100:00100000:1.0:1787603977.518233:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345775616 00000100:00100000:1.0:1787603977.518300:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00100000:1.0:1787603977.518311:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:10548:x1874438345775616:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787603977.519110:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:10548:x1874438345775616:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 799us (999us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787603977.519120:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00100000:2.0:1787603977.528239:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603977.528344:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345775872 00000100:00100000:0.0:1787603977.528355:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345775872 00000100:00100000:0.0:1787603977.528414:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 121 00000100:00100000:0.0:1787603977.528424:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:10548:x1874438345775872:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787603977.528560:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:10548:x1874438345775872:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 136us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603977.528568:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 121 00000100:00100000:0.0:1787603977.531443:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603977.531556:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345776000 00000100:00100000:3.0:1787603977.531565:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345776000 00000100:00100000:3.0:1787603977.531625:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 122 00000100:00100000:3.0:1787603977.531636:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:10548:x1874438345776000:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787603977.531656:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603977.531678:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901cab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ba8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.531772:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901cb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.531786:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.531815:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603977.531888:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787603977.531918:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.531944:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901cab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ba8 expref: 62 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.531974:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ba8 expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.531982:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603977.531985:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787603977.531989:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac800, rc 0) 00000100:00100000:3.0:1787603977.532339:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+61:10548:x1874438345776000:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 703us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603977.532346:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 122 00000100:00100000:3.0:1787603977.539964:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603977.540294:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345776128 00000100:00100000:2.0:1787603977.540305:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345776128 00000100:00100000:2.0:1787603977.540365:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 38 00000100:00100000:2.0:1787603977.540375:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2363:x1874438345776128:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787603977.540392:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603977.540435:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1901cb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5baf expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787603977.540463:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8cac09, blocks: 0x1 00010000:00010000:2.0:1787603977.540484:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:2.0:1787603977.540490:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787603977.540499:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1901cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5baf expref: 10 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.540519:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1901cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5baf expref: 10 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.540546:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963600, rc 0) 00000100:00100000:2.0:1787603977.540610:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:2363:x1874438345776128:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 235us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603977.540617:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 38 00000100:00100000:2.0:1787603977.553330:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603977.553433:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345776384 00000100:00100000:0.0:1787603977.553443:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345776384 00000100:00100000:0.0:1787603977.553502:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 123 00000100:00100000:0.0:1787603977.553513:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+61:10548:x1874438345776384:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787603977.553632:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+61:10548:x1874438345776384:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 121us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603977.553640:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 123 00000100:00100000:1.0:1787603977.560086:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603977.560251:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345776512 00000100:00100000:0.0:1787603977.560262:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345776512 00000100:00100000:0.0:1787603977.560369:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 39 00000100:00100000:0.0:1787603977.560380:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:10548:x1874438345776512:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787603977.560398:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603977.560416:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5bb6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.560449:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1901cb9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5baf expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.560470:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787603977.560475:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787603977.560480:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bb6 expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.560528:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1901cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5baf expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.560775:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1901cb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5baf expref: 11 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603977.560790:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874438355223424:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603977.560929:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787603977.563323:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874438355223424:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603977.563355:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bb6 expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.563374:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595200, rc 0) 00000100:00100000:0.0:1787603977.564723:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:10548:x1874438345776512:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 4337us (4817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603977.564734:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 39 00000100:00100000:2.0:1787603977.576259:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603977.576667:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345776640 00000100:00100000:1.0:1787603977.576678:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345776640 00010000:00010000:1.0:1787603977.576735:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1901cb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5baf expref: 11 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603977.576907:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 53 00000100:00100000:1.0:1787603977.576919:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa48d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:2364:x1874438345776640:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603977.576936:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603977.576970:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1901cb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5baf expref: 11 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.577013:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1901cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5baf expref: 11 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.577038:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1901cb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5baf expref: 11 pid: 6678 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.577055:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603977.577059:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603977.577067:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bb6 expref: 10 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.577077:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bb6 expref: 10 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.577115:0:6693:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bb6 expref: 10 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603977.577129:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6693:1874438355223552:192.168.202.21@tcp:105: 00000100:00100000:1.0:1787603977.577218:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2986fb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787603977.584914:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603977.587613:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6693:1874438355223552:192.168.202.21@tcp:105: 00010000:00010000:1.0:1787603977.587641:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603977.587740:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa48d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:2364:x1874438345776640:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 10822us (11489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603977.591268:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345776768 00000100:00100000:2.0:1787603977.591280:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345776768 00002000:00100000:2.0:1787603977.591348:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ed2b4bd8380 x1874438345776768/t0(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:303/0 lens 504/0 e 0 to 0 dl 1787603988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787603977.591359:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2b4bd8380 with x1874438345776768 ext(0->12) 00002000:00010000:2.0:1787603977.591365:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2b4bd8380 00000100:00100000:2.0:1787603977.591405:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 2 00000100:00100000:2.0:1787603977.591415:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:2363:x1874438345776768:12345-192.168.202.21@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787603977.591993:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:2363:x1874438345776768:12345-192.168.202.21@tcp:4:lhsmtool_posix.0 Request processed in 577us (7098us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787603977.592001:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 2 00002000:00100000:2.0:1787603977.592018:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ed2b4bd8380 x1874438345776768/t4294967308(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:303/0 lens 504/448 e 0 to 0 dl 1787603988 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787603977.592027:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2b4bd8380 with x1874438345776768 ext(0->12) 00002000:00010000:2.0:1787603977.592030:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2b4bd8380 00000100:00100000:1.0:1787603977.592709:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 53 00000100:00100000:3.0:1787603977.599369:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603977.599506:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345776896 00000100:00100000:2.0:1787603977.599522:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345776896 00000100:00100000:2.0:1787603977.599594:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 124 00000100:00100000:2.0:1787603977.599606:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+61:10548:x1874438345776896:12345-192.168.202.21@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1787603977.622934:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787603977.654119:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967391 is committed 00000004:00080000:0.0:1787603977.654137:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787603977.654162:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2bf6c6300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787603977.654166:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed2b6116500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2bf6c6c00 00000020:00080000:0.0:1787603977.654169:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed2b6116100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2986e6000 00000004:00080000:0.0:1787603977.654182:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1787603977.654196:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787603977.654216:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787603977.654248:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2c1ca4180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787603977.654250:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed2af094e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2c1ca4300 00000020:00080000:0.0:1787603977.654253:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed2af094f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2b4be6400 00000020:00080000:0.0:1787603977.654270:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787603977.654306:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787603977.654497:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787603977.655044:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:10548:x1874438345776896:12345-192.168.202.21@tcp:44:lhsmtool_posix.0 Request processed in 55435us (55685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603977.655054:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 124 00000100:00100000:3.0:1787603977.655486:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355223936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787603977.655556:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603977.655607:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355223936 00000100:00100000:3.0:1787603977.655613:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355223936 00000100:00100000:3.0:1787603977.655668:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787603977.655676:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355223936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787603977.655866:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787603977.655870:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787603977 00002000:00010000:3.0:1787603977.655872:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787603977.655874:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787603977 -> 1787603977 00002000:00010000:3.0:1787603977.655876:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787603977.655915:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3281:x1874438355223936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 238us (358us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787603977.655922:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787603977.655942:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787603977.655974:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2b4bdad80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787603977.655981:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355223936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787603977.656645:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355223680:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787603977.656695:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603977.656731:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787603977.656737:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355223808:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787603977.656769:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603977.656933:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355223680 00000100:00100000:0.0:1787603977.656938:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355223680 00000100:00100000:0.0:1787603977.656968:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355223808 00000100:00100000:0.0:1787603977.656971:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355223808 00000100:00100000:0.0:1787603977.656983:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787603977.656990:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355223680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787603977.657009:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1787603977.657036:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8cac07, atime: 0x6a8cac07, ctime: 0x6a8cac07, blocks: 0xb 00010000:00010000:0.0:1787603977.657044:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000746bac5c/0xb5d1f3b1a1901cc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.657060:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=310s v=(0 0) 00010000:00010000:0.0:1787603977.657064:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787603977.657071:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000746bac5c/0xb5d1f3b1a1901cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.657086:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000746bac5c/0xb5d1f3b1a1901cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.657096:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000746bac5c/0xb5d1f3b1a1901cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.657116:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000746bac5c/0xb5d1f3b1a1901cc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.657132:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787603977.657831:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1874438355223680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 837us (1141us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787603977.657875:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787603977.657896:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787603977.657906:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3283:x1874438355223808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787603977.657921:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1787603977.657935:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.657951:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1901a89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b15 expref: 11 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.657958:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1787603977.657961:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787603977.657965:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.657991:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1901a89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b15 expref: 11 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.658004:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1901a89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b15 expref: 11 pid: 6678 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603977.658023:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874438355224064:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603977.658077:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7840 going to sleep for 11 seconds 00010000:00010000:0.0:1787603977.658095:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787603977.658101:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000746bac5c/0xb5d1f3b1a1901cc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.658109:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594600 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787603977.658113:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000746bac5c/0xb5d1f3b1a1901cc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.658122:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000746bac5c/0xb5d1f3b1a1901cc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.658138:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000746bac5c/0xb5d1f3b1a1901cc7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.658144:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000746bac5c/0xb5d1f3b1a1901cc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.658161:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603977.658162:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603977.658164:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603977.658187:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787603977.658191:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1787603977.658213:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2bf213800, transno 4294967301 00000004:00080000:0.0:1787603977.658226:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1787603977.658240:0:3283:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed2b4bdbb80 x1874438355223680/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787603993 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787603977.658250:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2b4bdbb80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787603977.658254:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355223680:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1787603977.661330:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603977.664871:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603977.664919:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603977.664998:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345777152 00000100:00100000:2.0:1787603977.665007:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345777152 00000100:00100000:2.0:1787603977.665055:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 43 00000100:00100000:2.0:1787603977.665064:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+12:2363:x1874438345777152:12345-192.168.202.21@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787603977.665196:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345777024 00000100:00100000:1.0:1787603977.665200:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345777024 00010000:00010000:1.0:1787603977.665224:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1901a89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b15 expref: 13 pid: 6678 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603977.665255:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 54 00000100:00100000:1.0:1787603977.665263:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:2363:x1874438345777024:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603977.665273:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603977.665279:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1901a89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b15 expref: 13 pid: 6678 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.665293:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1901a89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b15 expref: 13 pid: 6678 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.665314:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787603977.665318:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787603977.665323:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.665332:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.665349:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603977.665392:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:2363:x1874438345777024:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 130us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603977.665399:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 54 00010000:00010000:0.0:1787603977.671705:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1901a89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b15 expref: 12 pid: 6678 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603977.671729:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874438355224064:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603977.671753:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.671970:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.671980:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.671991:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.671999:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.672016:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787603977.672538:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787603977.672552:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.672560:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594e00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787603977.672564:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.672572:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.672591:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.672597:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901cce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.672615:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603977.672617:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603977.672618:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603977.672721:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3283:x1874438355223808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14816us (15948us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787603977.672730:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1787603977.673583:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2b4bd8a80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787603977.673593:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355223808:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1787603977.721646:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1787603977.721668:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1787603977.721695:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1787603977.721973:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345777152:12345-192.168.202.21@tcp:16:lhsmtool_posix.0 Request processed in 56903us (57047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603977.721984:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 43 00000100:00100000:3.0:1787603977.726577:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603977.727163:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345777408 00000100:00100000:0.0:1787603977.727174:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345777408 00000100:00100000:1.0:1787603977.730126:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 125 00000100:00100000:1.0:1787603977.730140:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:10548:x1874438345777408:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787603977.730192:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603977.730219:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1901cb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ba8 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.730239:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:1.0:1787603977.730244:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787603977.730287:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901cd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.730299:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.730309:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787603977.730556:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ee1668d reply state 00000000211dc9ae transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603977.730566:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787603977.730683:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:10548:x1874438345777408:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 537us (4107us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787603977.730708:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 125 00010000:00010000:3.0:1787603977.738051:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.738069:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901cd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.738076:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.738082:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fc00 already unused, calling callback (ffffffffc22204f0) 00000100:00100000:0.0:1787603977.738097:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00010000:00010000:3.0:1787603977.738103:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.738111:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901cd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.738128:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:3.0:1787603977.738132:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603977.738136:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901cd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.738143:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901cd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603977.738199:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345777536 00000100:00100000:2.0:1787603977.738211:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345777536 00000100:00100000:2.0:1787603977.738268:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 44 00000100:00100000:2.0:1787603977.738279:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345777536:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787603977.738565:0:10671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787603977.738569:0:10671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787603977 -> 1787603976 00002000:00010000:2.0:1787603977.738572:0:10671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787603975 00002000:00010000:2.0:1787603977.738580:0:10671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787603977 -> 1787603976 00002000:00010000:2.0:1787603977.738582:0:10671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787603977.738655:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345777536:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 Request processed in 376us (562us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787603977.738662:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 44 00000100:00100000:3.0:1787603977.748136:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603977.748318:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345777792 00000100:00100000:0.0:1787603977.748329:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345777792 00000100:00100000:0.0:1787603977.748395:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 126 00000100:00100000:0.0:1787603977.748406:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:10548:x1874438345777792:12345-192.168.202.21@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787603977.748475:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.748503:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901c96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b9a expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.748532:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.748569:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b9a expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.748582:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901c96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b9a expref: 15 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603977.748596:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355224192:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603977.748724:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787603977.752517:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355224192:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603977.752550:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603977.754364:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603977.754595:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345777920 00000100:00100000:0.0:1787603977.754605:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345777920 00010000:00010000:0.0:1787603977.754650:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901c96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b9a expref: 16 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603977.754816:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 55 00000100:00100000:0.0:1787603977.754827:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:2364:x1874438345777920:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787603977.754883:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603977.754892:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901c96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b9a expref: 16 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.754906:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b9a expref: 16 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.754927:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901c96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b9a expref: 16 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.754959:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:0.0:1787603977.754964:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.754973:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.754992:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.755020:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603977.755071:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:2364:x1874438345777920:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 245us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603977.755078:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 55 00010000:00010000:2.0:1787603977.755143:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.755151:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.755178:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.755185:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.755190:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.755196:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603977.755199:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.755206:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.755215:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:2.0:1787603977.755217:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787603977.755220:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.755238:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901cdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603977.755281:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:10548:x1874438345777792:12345-192.168.202.21@tcp:55:lhsmtool_posix.0 Request processed in 6877us (7155us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787603977.755289:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 126 00000100:00100000:0.0:1787603977.762024:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603977.764794:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345778048 00000100:00100000:2.0:1787603977.764811:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345778048 00000100:00100000:2.0:1787603977.764973:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 45 00000100:00100000:2.0:1787603977.764985:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2365:x1874438345778048:12345-192.168.202.21@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787603977.765031:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.765052:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bb6 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.765059:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787603977.765063:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787603977.765067:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.765105:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bb6 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.765119:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bb6 expref: 7 pid: 6676 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603977.765153:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874438355224320:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787603977.765241:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2985b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787603977.771540:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603977.771652:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874438355224320:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787603977.771702:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603977.771907:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345778176 00000100:00100000:1.0:1787603977.771916:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345778176 00010000:00010000:1.0:1787603977.771951:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bb6 expref: 8 pid: 6676 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603977.771991:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 56 00000100:00100000:1.0:1787603977.772003:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af051f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2363:x1874438345778176:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603977.772017:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603977.772040:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bb6 expref: 8 pid: 6676 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.772066:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bb6 expref: 8 pid: 6676 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.772089:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901cc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bb6 expref: 8 pid: 6676 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.772104:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787603977.772108:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787603977.772114:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.772124:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.772160:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603977.772208:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af051f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345778176:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 209us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603977.772216:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 56 00010000:00010000:3.0:1787603977.772401:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.772411:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.772436:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.772444:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.772452:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.772467:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962a00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787603977.772471:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.772481:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.772788:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.772797:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b141537d/0xb5d1f3b1a1901ce3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603977.772888:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2365:x1874438345778048:12345-192.168.202.21@tcp:1:lhsmtool_posix.0 Request processed in 7905us (10872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603977.772895:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 45 00000100:00100000:3.0:1787603977.776820:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603977.780759:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345778432 00000100:00100000:2.0:1787603977.780775:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345778432 00000100:00100000:2.0:1787603977.780924:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 127 00000100:00100000:2.0:1787603977.780938:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:10548:x1874438345778432:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787603977.781020:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901cea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.781039:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901cea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.781052:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901cea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.781267:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.781279:0:7875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ca4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ba1 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.781287:0:7875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.781337:0:7875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ca4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ba1 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.781351:0:7875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ca4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ba1 expref: 15 pid: 5821 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603977.781365:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355224448:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787603977.781475:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2985b7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787603977.791802:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603977.792134:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355224448:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787603977.792164:0:7875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603977.794405:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345778560 00000100:00100000:3.0:1787603977.794419:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345778560 00010000:00010000:2.0:1787603977.802813:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ca4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ba1 expref: 16 pid: 5821 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603977.802900:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 57 00000100:00100000:2.0:1787603977.802912:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:2364:x1874438345778560:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603977.802929:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603977.802937:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ca4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ba1 expref: 16 pid: 5821 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.802950:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ca4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ba1 expref: 16 pid: 5821 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.802971:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ca4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ba1 expref: 16 pid: 5821 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.803005:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:2.0:1787603977.803010:0:6693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.803018:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.803025:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.803062:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603977.803121:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:2364:x1874438345778560:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 207us (11325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603977.803128:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 57 00010000:00010000:3.0:1787603977.803218:0:7875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.803226:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787603977.803395:0:7875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787603977.803552:0:7875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787603977.803597:0:7875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787603977.803697:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed286af1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7875:1874438355224576:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787603977.803757:0:7875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603977.803794:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28670a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603977.805270:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355224576 00000100:00100000:2.0:1787603977.805281:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355224576 00000100:00100000:2.0:1787603977.805330:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787603977.805340:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7875:x1874438355224576:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787603977.805461:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7875:x1874438355224576:12345-0@lo:1000:mdt00_003.0 Request processed in 122us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603977.805529:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787603977.805816:0:7875:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787603977.805822:0:7875:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1787603977.805873:0:7875:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2b4bdad80, transno 4294967309 00000100:00100000:0.0:1787603977.805891:0:7875:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed2b4bd8a80 x1874438355223808/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787603993 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787603977.805903:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed286af1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7875:1874438355224576:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787603977.806356:0:7875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787603977.806426:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7875:1874438355224704:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787603977.806478:0:7875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603977.806514:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7840 going to sleep for 11 seconds 00000100:00100000:2.0:1787603977.806867:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355224704 00000100:00100000:2.0:1787603977.806873:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355224704 00000100:00100000:2.0:1787603977.806912:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787603977.806922:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7875:x1874438355224704:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787603977.807092:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7875:x1874438355224704:12345-0@lo:1000:mdt00_003.0 Request processed in 171us (612us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787603977.807110:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787603977.807460:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7875:1874438355224704:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787603977.807569:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.807581:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.807589:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.807595:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603977.807601:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.807609:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.807626:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5b00) 00010000:00010000:0.0:1787603977.807629:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787603977.807634:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.807641:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901cf1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.808905:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901c34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.808922:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901c34 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.808930:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901c34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.808958:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603977.808963:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901c34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.808971:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901c34 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.808985:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:0.0:1787603977.808987:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787603977.808994:0:7875:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901c3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b85 expref: 18 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.809005:0:7875:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901c3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b85 expref: 18 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.809013:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901c3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b85 expref: 18 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.809058:0:7875:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901c3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b85 expref: 18 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603977.809074:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355224832:192.168.202.21@tcp:105: 00000100:00100000:0.0:1787603977.809174:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2986fbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787603977.817160:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355224832:192.168.202.21@tcp:105: 00010000:00010000:0.0:1787603977.817190:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901c34 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817219:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1901c34 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817250:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901cf8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817265:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901cf8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817275:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901cf8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817286:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901cf8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817293:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901cf8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817299:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901cf8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817304:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603977.817308:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901cf8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817315:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901cf8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817326:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:0.0:1787603977.817330:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603977.817334:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901cf8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817346:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901cf8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817357:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901cea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817364:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901cea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817369:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901cea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817374:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603977.817376:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901cea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817382:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901cea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817389:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:0.0:1787603977.817391:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787603977.817394:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901cea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.817400:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901cea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603977.817664:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:10548:x1874438345778432:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 36727us (40853us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787603977.818061:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 127 00000020:00080000:0.0:1787603977.818077:0:7875:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787603977.818975:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787603977.818982:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787603977.819422:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787603977.819431:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787603977.820954:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603977.822128:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345778688 00000100:00100000:1.0:1787603977.822140:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345778688 00000100:00100000:1.0:1787603977.822200:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 31 00000100:00100000:1.0:1787603977.822222:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:10547:x1874438345778688:12345-192.168.202.21@tcp:49:lfs.0 00000100:00100000:1.0:1787603977.822363:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:10547:x1874438345778688:12345-192.168.202.21@tcp:49:lfs.0 Request processed in 143us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603977.822370:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 31 00000100:00100000:3.0:1787603977.837261:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603977.837357:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345778944 00000100:00100000:2.0:1787603977.837366:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345778944 00000100:00100000:2.0:1787603977.837432:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 128 00000100:00100000:2.0:1787603977.837442:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:10547:x1874438345778944:12345-192.168.202.21@tcp:58:lfs.0 00000040:00080000:2.0:1787603977.837825:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787603977.837949:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:10547:x1874438345778944:12345-192.168.202.21@tcp:58:lfs.0 Request processed in 507us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603977.837957:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 128 00000100:00100000:3.0:1787603977.842819:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603977.843063:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345779200 00000100:00100000:1.0:1787603977.843074:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345779200 00000100:00100000:1.0:1787603977.843138:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 32 00000100:00100000:1.0:1787603977.843148:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed291f92050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:10548:x1874438345779200:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787603977.843832:0:11963:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787603977.843972:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787603977.844027:0:11963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901cff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.844043:0:11963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901cff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.844054:0:11963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901cff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.844063:0:11963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901cff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.844068:0:11963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901cff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.844074:0:11963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901cff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.844099:0:11963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787603977.844277:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787603977.844283:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901cff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.844291:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f600 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787603977.844295:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901cff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.844301:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901cff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.844314:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ed291bd5900) 00010000:00010000:3.0:1787603977.844316:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787603977.844319:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901cff lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.844324:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901cff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603977.844338:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603977.844340:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603977.844341:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603977.844518:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed291f92050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:10548:x1874438345779200:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 1368us (1704us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787603977.844537:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 32 00000020:00080000:1.0:1787603977.844542:0:11963:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787603977.903241:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603977.903317:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345779328 00000100:00100000:0.0:1787603977.903327:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345779328 00000100:00100000:0.0:1787603977.903384:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 129 00000100:00100000:0.0:1787603977.903396:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:10551:x1874438345779328:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603977.903428:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603977.903450:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901d06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5bbd expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.903519:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901d0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.903797:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901d0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.903809:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901d0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.903826:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901d14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.903834:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.903875:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.904189:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.904202:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b7e expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.904218:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901d1b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.904253:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b7e expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603977.904268:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b7e expref: 21 pid: 5822 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603977.904282:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355224960:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603977.904387:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2986fb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787603977.907424:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603977.909014:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345779584 00000100:00100000:2.0:1787603977.909027:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345779584 00000100:00100000:2.0:1787603977.909098:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 33 00000100:00100000:2.0:1787603977.909120:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:5606:x1874438345779584:12345-192.168.202.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787603977.909367:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:5606:x1874438345779584:12345-192.168.202.21@tcp:35:ldlm_bl.0 Request processed in 258us (1961us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787603977.909374:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 33 00000100:00100000:3.0:1787603977.914732:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603977.914912:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345779712 00000100:00100000:2.0:1787603977.914923:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345779712 00010000:00010000:2.0:1787603977.914971:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b7e expref: 23 pid: 5822 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603977.915019:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 58 00000100:00100000:2.0:1787603977.915030:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b606d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:2363:x1874438345779712:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603977.915045:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603977.915053:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b7e expref: 23 pid: 5822 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.915076:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b7e expref: 23 pid: 5822 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.915099:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:2.0:1787603977.915105:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.915116:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.915122:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901d1b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603977.915142:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603977.915202:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b606d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:2363:x1874438345779712:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 173us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603977.915211:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 58 00010000:00010000:1.0:1787603977.917930:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901c26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b7e expref: 22 pid: 5822 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603977.917958:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355224960:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603977.917983:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.917993:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.917998:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603977.918042:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787603977.918047:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787603977.918632:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.918651:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.918661:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901d0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.918667:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901d0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.918771:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901d0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.918777:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603977.918781:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901d0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.918789:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901d0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.918804:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:1.0:1787603977.918808:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603977.918813:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901d0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.918818:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901d0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.918832:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.919743:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901d14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.919751:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901d14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.919757:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603977.919761:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901d14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.919783:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901d14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.919795:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ed28870b200) 00010000:00010000:1.0:1787603977.919798:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603977.919802:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901d14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.919809:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901d14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.919882:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901d06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bbd expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.919897:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901d1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bbd expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603977.919905:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:1.0:1787603977.919907:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787603977.919910:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595600, rc 0) 00000100:00100000:1.0:1787603977.919986:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:10551:x1874438345779328:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 16590us (16751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603977.919994:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 129 00000100:00100000:3.0:1787603978.200104:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787603978.200127:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355225088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603978.200202:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603978.200269:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355225088 00000100:00100000:3.0:1787603978.200276:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355225088 00000100:00100000:3.0:1787603978.200325:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787603978.200335:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355225088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787603978.200369:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787603978.200622:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355225344:0@lo:400:kworker.0 00000100:00100000:2.0:1787603978.200657:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603978.200679:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787603978.200698:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355225216:0@lo:400:kworker.0 00000100:00100000:2.0:1787603978.200727:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603978.200764:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355225728:0@lo:400:kworker.0 00000100:00100000:2.0:1787603978.200788:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603978.200816:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355225216 00000100:00100000:2.0:1787603978.200820:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355225216 00000100:00100000:2.0:1787603978.200902:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787603978.200923:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed28712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355225216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603978.200961:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed28712a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355225216:12345-0@lo:400:kworker.0 Request processed in 39us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603978.200968:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787603978.201004:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355225600:0@lo:400:kworker.0 00000100:00100000:2.0:1787603978.201027:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603978.201048:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787603978.201053:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355225472:0@lo:400:kworker.0 00000100:00100000:2.0:1787603978.201075:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603978.201102:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355225344 00000100:00100000:2.0:1787603978.201105:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355225344 00000100:00100000:2.0:1787603978.201131:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355225600 00000100:00100000:2.0:1787603978.201135:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355225600 00000100:00100000:2.0:1787603978.201155:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355225472 00000100:00100000:2.0:1787603978.201158:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355225472 00000100:00100000:2.0:1787603978.201173:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787603978.201178:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355225344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603978.201208:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355225344:12345-0@lo:400:kworker.0 Request processed in 30us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603978.201214:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787603978.201226:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787603978.201231:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355225600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603978.201257:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355225600:12345-0@lo:400:kworker.0 Request processed in 26us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603978.201262:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787603978.201273:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787603978.201279:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355225472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603978.201311:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355225472:12345-0@lo:400:kworker.0 Request processed in 33us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603978.201317:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1787603978.201339:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603978.201364:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355225472:0@lo:400:kworker.0 00000100:00100000:2.0:1787603978.201374:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355225600:0@lo:400:kworker.0 00000100:00100000:2.0:1787603978.201397:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355225216:0@lo:400:kworker.0 00000100:00100000:2.0:1787603978.201405:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355225344:0@lo:400:kworker.0 00000100:00100000:0.0:1787603978.201564:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355225088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603978.201593:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355225728 00000100:00100000:0.0:1787603978.201597:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355225728 00000100:00100000:0.0:1787603978.201625:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787603978.201632:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355225728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603978.201666:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355225728:12345-0@lo:400:kworker.0 Request processed in 36us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603978.201672:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787603978.201830:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355225728:0@lo:400:kworker.0 00000100:00100000:3.0:1787603978.201967:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355225088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603978.201978:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:0.0:1787603978.647153:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603978.712043:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787603978.712083:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355225856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787603978.712150:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603978.712320:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355225856 00000100:00100000:3.0:1787603978.712328:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355225856 00000100:00100000:3.0:1787603978.712387:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787603978.712398:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874438355225856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787603978.712422:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787603978.712472:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874438355225856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603978.712479:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787603978.712538:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355225856:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787603978.845171:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787603978.845181:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787603978.845229:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787603978.845235:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787603978.845361:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874438355225984:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787603978.845474:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed284e31840 going to sleep for 11 seconds 00000100:00100000:3.0:1787603978.849753:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603978.849920:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345779840 00000100:00100000:1.0:1787603978.849929:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345779840 00000100:00100000:1.0:1787603978.850005:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 130 00000100:00100000:1.0:1787603978.850017:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:10562:x1874438345779840:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787603978.850053:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787603978.850158:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:10562:x1874438345779840:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 Request processed in 142us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603978.850165:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 130 00000100:00080000:3.0:1787603978.853352:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603978.853638:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603978.853940:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345780096 00000100:00100000:3.0:1787603978.853950:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345780096 00000100:00100000:3.0:1787603978.854006:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 131 00000100:00100000:3.0:1787603978.854017:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:10562:x1874438345780096:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787603978.854036:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603978.854067:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901d22 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5bc4 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.854166:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901d29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.854179:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.854190:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603978.854202:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787603978.854332:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901d22 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bc4 expref: 25 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.854350:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bc4 expref: 24 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.854359:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:3.0:1787603978.854362:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787603978.854365:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad200, rc 0) 00000100:00100000:3.0:1787603978.854432:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:10562:x1874438345780096:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 417us (800us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787603978.854440:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 131 00000100:00100000:2.0:1787603978.862762:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874438355225984:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787603978.865828:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603978.867053:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345780224 00000100:00100000:2.0:1787603978.867069:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345780224 00000100:00100000:2.0:1787603978.867141:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:2.0:1787603978.867152:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:2363:x1874438345780224:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603978.867167:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603978.867192:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1901d29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bc4 expref: 23 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603978.867226:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:2.0:1787603978.867232:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603978.867297:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:2363:x1874438345780224:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 147us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603978.867305:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:0.0:1787603978.873620:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603978.873886:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345780480 00000100:00100000:3.0:1787603978.873897:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345780480 00000100:00100000:3.0:1787603978.873960:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 132 00000100:00100000:3.0:1787603978.873972:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:10562:x1874438345780480:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787603978.874072:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.874090:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.874102:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.874288:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.874296:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.874303:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.874309:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603978.874314:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.874320:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.874332:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:3.0:1787603978.874335:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787603978.874341:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603978.874347:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603978.874977:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:10562:x1874438345780480:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 1003us (1362us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787603978.874986:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 132 00000040:00080000:3.0:1787603978.875123:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787603978.875128:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787603978.881139:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787603978.881158:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787603978.881708:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603978.881834:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345780736 00000100:00100000:3.0:1787603978.881875:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345780736 00000100:00100000:3.0:1787603978.881936:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 34 00000100:00100000:3.0:1787603978.881949:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:10562:x1874438345780736:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787603978.882180:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:10562:x1874438345780736:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 233us (477us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787603978.882188:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 34 00000040:00080000:0.0:1787603978.943953:0:12036:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787603978.943963:0:12036:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787603978.944011:0:12036:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787603978.944025:0:12036:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787603979.193298:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603979.193644:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345780992 00000100:00100000:1.0:1787603979.193655:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345780992 00000100:00100000:1.0:1787603979.193800:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 133 00000100:00100000:1.0:1787603979.193811:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:10575:x1874438345780992:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787603979.193955:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603979.193976:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901d3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5bcb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603979.194074:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901d45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603979.194263:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603979.194278:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603979.194292:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787603979.194419:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901d3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bcb expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603979.194435:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901d45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bcb expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603979.194457:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:1.0:1787603979.194460:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787603979.194463:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e600, rc 0) 00000100:00100000:1.0:1787603979.194558:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:10575:x1874438345780992:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 748us (1267us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787603979.194566:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 133 00000100:00100000:0.0:1787603979.199452:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603979.199819:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345781120 00000100:00100000:3.0:1787603979.199831:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345781120 00000100:00100000:3.0:1787603979.200005:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 134 00000100:00100000:3.0:1787603979.200015:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:10575:x1874438345781120:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:3.0:1787603979.200074:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603979.200100:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603979.200112:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603979.200151:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603979.200158:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603979.200165:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603979.200171:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603979.200175:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603979.200182:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603979.200193:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:3.0:1787603979.200195:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787603979.200199:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603979.200206:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad000/0xb5d1f3b1a1901d53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603979.200270:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:10575:x1874438345781120:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 256us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603979.200277:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 134 00000100:00100000:0.0:1787603979.263359:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603979.263476:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345781248 00000100:00100000:3.0:1787603979.263487:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345781248 00000100:00100000:3.0:1787603979.263630:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 46 00000100:00100000:3.0:1787603979.263656:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2366:x1874438345781248:12345-192.168.202.21@tcp:101:cat.0 00010000:00010000:3.0:1787603979.263694:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603979.263715:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1901d5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5bd2 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787603979.263741:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8cac08, atime: 0x6a8cac07, ctime: 0x6a8cac08, blocks: 0xb 00010000:00010000:3.0:1787603979.263759:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=312s v=(0 0) 00010000:00010000:3.0:1787603979.263765:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787603979.263775:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1901d5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bd2 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603979.263794:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1901d5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bd2 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603979.263807:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad000, rc 0) 00000100:00100000:3.0:1787603979.263894:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2366:x1874438345781248:12345-192.168.202.21@tcp:101:cat.0 Request processed in 241us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603979.263901:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 46 00000100:00080000:2.0:1787603979.265922:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787603979.272076:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603979.272263:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345781376 00000100:00100000:1.0:1787603979.272273:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345781376 00002000:00100000:1.0:1787603979.272325:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9ed2b4bd4000 x1874438345781376/t0(0) o3->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:305/0 lens 488/0 e 0 to 0 dl 1787603990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787603979.272336:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2b4bd4000 with x1874438345781376 ext(0->4095) 00002000:00010000:1.0:1787603979.272342:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2b4bd4000 00000100:00100000:1.0:1787603979.272471:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3 00000100:00100000:1.0:1787603979.272482:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2365:x1874438345781376:12345-192.168.202.21@tcp:3:cat.0 00000100:00100000:1.0:1787603979.272717:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2365:x1874438345781376:12345-192.168.202.21@tcp:3:cat.0 Request processed in 236us (652us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787603979.272726:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3 00002000:00100000:1.0:1787603979.272733:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9ed2b4bd4000 x1874438345781376/t0(0) o3->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:305/0 lens 488/4536 e 0 to 0 dl 1787603990 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787603979.272742:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2b4bd4000 with x1874438345781376 ext(0->4095) 00002000:00010000:1.0:1787603979.272745:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2b4bd4000 00010000:00010000:1.0:1787603979.672110:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787603980.695577:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603981.098515:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603981.098561:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603981.098596:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603981.098629:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345782016 00000100:00100000:1.0:1787603981.098637:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345782016 00000100:00100000:1.0:1787603981.098714:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 138 00000100:00100000:1.0:1787603981.098724:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345782016:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603981.098792:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345782016:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 70us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603981.098799:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 138 00000100:00080000:1.0:1787603981.098817:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603981.098960:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345781504 00000100:00100000:3.0:1787603981.098964:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345781504 00000100:00100000:3.0:1787603981.098996:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 289 00000100:00100000:3.0:1787603981.099003:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345781504:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603981.099034:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345781504:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 32us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603981.099039:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 289 00000100:00100000:0.0:1787603981.099884:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345781760 00000100:00100000:0.0:1787603981.099893:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345781760 00000100:00100000:0.0:1787603981.099933:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 59 00000100:00100000:0.0:1787603981.099940:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2365:x1874438345781760:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603981.099979:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2365:x1874438345781760:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 40us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603981.099985:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 59 00000100:00080000:1.0:1787603981.100100:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787603981.101325:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603981.101364:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603981.101437:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345781632 00000100:00100000:3.0:1787603981.101444:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345781632 00000100:00100000:3.0:1787603981.101511:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 139 00000100:00100000:3.0:1787603981.101521:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:2365:x1874438345781632:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603981.101575:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:2365:x1874438345781632:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 56us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603981.101583:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 139 00000100:00100000:3.0:1787603981.101605:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345781888 00000100:00100000:3.0:1787603981.101609:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345781888 00000100:00100000:3.0:1787603981.101637:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 60 00000100:00100000:3.0:1787603981.101683:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2365:x1874438345781888:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603981.101710:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2365:x1874438345781888:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 67us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603981.101715:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 60 00000100:00080000:1.0:1787603981.101929:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787603981.101933:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787603981.388692:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:1.0:1787603981.719141:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603982.750525:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787603982.914988:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1787603982.915000:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1787603982.947904:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:2.0:1787603982.947919:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2865a7540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787603982.947924:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed2b6116a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2865a7cc0 00000020:00080000:2.0:1787603982.947927:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed2b6116600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2bf463400 00000020:00080000:2.0:1787603982.947939:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1787603982.947948:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787603982.948441:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787603982.948746:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:3.0:1787603982.999067:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787603982.999076:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787603982.999133:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787603982.999139:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787603983.319218:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355226368:0@lo:400:kworker.0 00000100:00100000:0.0:1787603983.319288:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603983.319345:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787603983.319351:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355226496:0@lo:400:kworker.0 00000100:00100000:0.0:1787603983.319377:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603983.319417:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355226368 00000100:00100000:0.0:1787603983.319424:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355226368 00000100:00100000:0.0:1787603983.319481:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787603983.319491:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355226368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603983.319544:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355226368:12345-0@lo:400:kworker.0 Request processed in 54us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603983.319551:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787603983.319575:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355226496 00000100:00100000:0.0:1787603983.319590:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355226496 00000100:00100000:0.0:1787603983.319619:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787603983.319626:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355226496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603983.319668:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355226496:12345-0@lo:400:kworker.0 Request processed in 43us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603983.319674:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1787603983.319689:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787603983.319694:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787603983.319716:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787603983.319721:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2b4bdbb80, transno 4294967304 00000100:00100000:0.0:1787603983.319734:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355226496:0@lo:400:kworker.0 00000100:00100000:0.0:1787603983.319746:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355226368:0@lo:400:kworker.0 00000100:00100000:0.0:1787603983.320135:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355226880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787603983.320163:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603983.320196:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355226880 00000100:00100000:0.0:1787603983.320200:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355226880 00000100:00100000:0.0:1787603983.320228:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787603983.320234:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355226880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787603983.320258:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603983.320294:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355226880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603983.320300:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787603983.320332:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355226880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787603983.320653:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355226112:0@lo:400:kworker.0 00000100:00100000:1.0:1787603983.320689:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603983.320725:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355226624:0@lo:400:kworker.0 00000100:00100000:1.0:1787603983.320750:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603983.320782:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787603983.320788:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355226240:0@lo:400:kworker.0 00000100:00100000:1.0:1787603983.320812:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603983.320831:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355226752:0@lo:400:kworker.0 00000100:00100000:1.0:1787603983.320877:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603983.320906:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355226624 00000100:00100000:1.0:1787603983.320910:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355226624 00000100:00100000:1.0:1787603983.320939:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355226240 00000100:00100000:1.0:1787603983.320951:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355226240 00000100:00100000:1.0:1787603983.320975:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787603983.320983:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355226624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603983.321020:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355226624:12345-0@lo:400:kworker.0 Request processed in 38us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603983.321026:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787603983.321039:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787603983.321045:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355226240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603983.321070:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355226240:12345-0@lo:400:kworker.0 Request processed in 25us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603983.321075:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787603983.321111:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355226752 00000100:00100000:1.0:1787603983.321115:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355226752 00000100:00100000:1.0:1787603983.321139:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787603983.321145:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355226752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603983.321176:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355226752:12345-0@lo:400:kworker.0 Request processed in 32us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603983.321181:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787603983.321205:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355226240:0@lo:400:kworker.0 00000100:00100000:1.0:1787603983.321213:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787603983.321217:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2b4bd8a80, transno 4294967310 00000004:00080000:1.0:1787603983.321228:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787603983.321247:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355226752:0@lo:400:kworker.0 00000100:00100000:1.0:1787603983.321258:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355226624:0@lo:400:kworker.0 00000100:00100000:0.0:1787603983.321971:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355226112 00000100:00100000:0.0:1787603983.321978:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355226112 00000100:00100000:0.0:1787603983.322020:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787603983.322037:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355226112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603983.322189:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355226112:0@lo:400:kworker.0 00000100:00100000:0.0:1787603983.322881:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355226112:12345-0@lo:400:kworker.0 Request processed in 843us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603983.322890:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:0.0:1787603983.322929:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787603983.322934:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787603983.767142:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603983.831165:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787603983.831354:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355227008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787603983.831436:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603983.834264:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355227008 00000100:00100000:0.0:1787603983.834278:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355227008 00000100:00100000:0.0:1787603983.834355:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787603983.834375:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355227008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787603983.834414:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603983.834644:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355227008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 268us (3196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603983.834652:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787603983.834921:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355227008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787603984.795925:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603985.815586:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787603986.098007:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603986.098883:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345782144 00000100:00100000:3.0:1787603986.098902:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345782144 00000100:00100000:3.0:1787603986.099007:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 135 00000100:00100000:3.0:1787603986.099023:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:10235:x1874438345782144:12345-192.168.202.21@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1787603986.099595:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787603986.100481:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:10235:x1874438345782144:12345-192.168.202.21@tcp:60:lhsmtool_posix.0 Request processed in 1455us (2481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603986.100517:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 135 00000100:00100000:3.0:1787603986.122016:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603986.125897:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345782400 00000100:00100000:2.0:1787603986.125918:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345782400 00000100:00100000:2.0:1787603986.126015:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 35 00000100:00100000:2.0:1787603986.126029:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:10235:x1874438345782400:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787603986.126798:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:10235:x1874438345782400:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 769us (4794us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787603986.126809:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 35 00000100:00100000:1.0:1787603986.261145:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603986.261206:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603986.261251:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603986.261296:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603986.261384:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345782656 00000100:00100000:3.0:1787603986.261395:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345782656 00000100:00100000:3.0:1787603986.261461:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345782784 00000100:00100000:3.0:1787603986.261464:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345782784 00000100:00100000:3.0:1787603986.261484:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 63 00000100:00100000:3.0:1787603986.261492:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2365:x1874438345782656:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603986.261569:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2365:x1874438345782656:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 78us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603986.261574:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 63 00000100:00100000:3.0:1787603986.261588:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 64 00000100:00100000:3.0:1787603986.261592:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2365:x1874438345782784:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603986.261606:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2365:x1874438345782784:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 15us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603986.261621:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 64 00000100:00100000:0.0:1787603986.261711:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345782912 00000100:00100000:0.0:1787603986.261716:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345782912 00000100:00100000:0.0:1787603986.261754:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 143 00000100:00100000:0.0:1787603986.261772:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345782912:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603986.261816:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2365:x1874438345782912:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 45us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603986.261823:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 143 00000100:00100000:2.0:1787603986.262694:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345782528 00000100:00100000:2.0:1787603986.262729:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345782528 00000100:00080000:1.0:1787603986.262777:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787603986.262783:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787603986.262785:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 291 00000100:00080000:1.0:1787603986.262786:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787603986.262794:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2366:x1874438345782528:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603986.262874:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2366:x1874438345782528:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 80us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603986.262881:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 291 00000100:00100000:0.0:1787603986.477448:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603986.477637:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345783040 00000100:00100000:1.0:1787603986.477652:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345783040 00000100:00100000:1.0:1787603986.477780:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 136 00000100:00100000:1.0:1787603986.477794:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:11028:x1874438345783040:12345-192.168.202.21@tcp:101:lsof.0 00010000:00010000:1.0:1787603986.477823:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603986.477873:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901d61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5bd9 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603986.477961:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901d68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603986.477978:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603986.477994:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603986.478539:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787603986.478545:0:7875:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787603986.478671:0:7875:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603986.478708:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901d61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bd9 expref: 7 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603986.478728:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bd9 expref: 6 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603986.478738:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:1.0:1787603986.478741:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787603986.478746:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f600, rc 0) 00000100:00100000:1.0:1787603986.479083:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:11028:x1874438345783040:12345-192.168.202.21@tcp:101:lsof.0 Request processed in 1291us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603986.479093:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 136 00010000:00010000:3.0:1787603986.839042:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787603987.865240:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787603987.996390:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1787603987.996437:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787603987.996860:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787603987.996874:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787603988.442359:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787603988.442403:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355227136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787603988.442518:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603988.443003:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355227392:0@lo:400:kworker.0 00000100:00100000:2.0:1787603988.443046:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603988.443071:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787603988.443077:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355227520:0@lo:400:kworker.0 00000100:00100000:2.0:1787603988.443101:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603988.443154:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355227392 00000100:00100000:2.0:1787603988.443164:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355227392 00000100:00100000:2.0:1787603988.443220:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355227520 00000100:00100000:2.0:1787603988.443224:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355227520 00000100:00100000:2.0:1787603988.443257:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787603988.443267:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355227392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603988.443350:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355227392:12345-0@lo:400:kworker.0 Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603988.443358:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787603988.443380:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787603988.443387:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355227520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787603988.443415:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355227520:12345-0@lo:400:kworker.0 Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603988.443421:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787603988.443464:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355227520:0@lo:400:kworker.0 00000100:00100000:2.0:1787603988.443497:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355227392:0@lo:400:kworker.0 00000100:00100000:1.0:1787603988.443784:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355227648:0@lo:400:kworker.0 00000100:00100000:1.0:1787603988.443825:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603988.443910:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787603988.443916:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355227264:0@lo:400:kworker.0 00000100:00100000:1.0:1787603988.443956:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603988.443981:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355227776:0@lo:400:kworker.0 00000100:00100000:1.0:1787603988.444019:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603988.444049:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355227264 00000100:00100000:1.0:1787603988.444053:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355227264 00000100:00100000:1.0:1787603988.444085:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787603988.444093:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355227264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603988.444131:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355227264:12345-0@lo:400:kworker.0 Request processed in 39us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603988.444137:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:1.0:1787603988.444166:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603988.444186:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355227264:0@lo:400:kworker.0 00000100:00100000:1.0:1787603988.444207:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355227648 00000100:00100000:1.0:1787603988.444211:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355227648 00000100:00100000:1.0:1787603988.444238:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787603988.444245:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355227648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603988.444293:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355227648:12345-0@lo:400:kworker.0 Request processed in 37us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603988.444300:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1787603988.444325:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787603988.444343:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355227648:0@lo:400:kworker.0 00000100:00100000:0.0:1787603988.444989:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355227136 00000100:00100000:0.0:1787603988.444996:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355227136 00000100:00100000:0.0:1787603988.445052:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787603988.445061:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355227136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787603988.445100:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787603988.445165:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355227136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (2648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603988.445171:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787603988.445265:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355227776 00000100:00100000:3.0:1787603988.445271:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355227776 00000100:00100000:3.0:1787603988.445331:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787603988.445339:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355227776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787603988.445381:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355227776:12345-0@lo:400:kworker.0 Request processed in 44us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603988.445396:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787603988.445446:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355227136:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787603988.446175:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787603988.446183:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787603988.446217:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355227776:0@lo:400:kworker.0 00010000:00010000:2.0:1787603988.887299:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603988.951371:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787603988.951415:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355227904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787603988.951522:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603988.951871:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355227904 00000100:00100000:3.0:1787603988.951882:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355227904 00000100:00100000:3.0:1787603988.951953:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787603988.951965:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355227904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787603988.952013:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603988.952086:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355227904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603988.952094:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787603988.952350:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355227904:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787603989.912809:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787603990.841707:0:12236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:39:49 (1787603989) 00010000:00010000:1.0:1787603990.943662:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603991.347053:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603991.347115:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603991.347155:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603991.347190:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603991.347221:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603991.347281:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345783168 00000100:00100000:1.0:1787603991.347304:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345783168 00000100:00100000:0.0:1787603991.347363:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345783680 00000100:00100000:0.0:1787603991.347370:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345783680 00000100:00100000:1.0:1787603991.347390:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 293 00000100:00100000:1.0:1787603991.347406:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2366:x1874438345783168:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603991.347431:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345783296 00000100:00100000:0.0:1787603991.347436:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345783296 00000100:00100000:0.0:1787603991.347463:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 147 00000100:00100000:0.0:1787603991.347471:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:2366:x1874438345783680:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787603991.347535:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2366:x1874438345783168:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 128us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603991.347546:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 293 00000100:00100000:3.0:1787603991.347576:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345783424 00000100:00100000:3.0:1787603991.347582:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345783424 00000100:00100000:3.0:1787603991.347617:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345783552 00000100:00100000:3.0:1787603991.347620:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345783552 00000100:00100000:3.0:1787603991.347661:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 66 00000100:00100000:3.0:1787603991.347669:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345783424:12345-192.168.202.21@tcp:400:kworker.0 00000100:00080000:1.0:1787603991.347831:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787603991.347865:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787603991.347869:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787603991.348015:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 148 00000100:00100000:2.0:1787603991.348026:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:2366:x1874438345783296:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787603991.348448:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:2366:x1874438345783680:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 974us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603991.348458:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 147 00000100:00100000:0.0:1787603991.348502:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 67 00000100:00100000:0.0:1787603991.348512:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2366:x1874438345783552:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603991.348520:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345783424:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 852us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603991.348528:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 66 00000100:00100000:0.0:1787603991.348547:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2366:x1874438345783552:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 38us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603991.348553:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 67 00000100:00100000:2.0:1787603991.349237:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:2366:x1874438345783296:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 1196us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603991.349250:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 148 00010000:00010000:2.0:1787603991.959284:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787603992.215815:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787603992.215829:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787603992.217273:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787603992.217289:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787603992.630623:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603992.631168:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345783936 00000100:00100000:1.0:1787603992.631184:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345783936 00000100:00100000:1.0:1787603992.631835:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 137 00000100:00100000:1.0:1787603992.632256:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:11293:x1874438345783936:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787603992.632526:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603992.632571:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901d6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5be0 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.632681:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901d76 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.632700:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901d76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.632727:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901d76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.632748:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901d7d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.632756:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901d7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.632764:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901d7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.635529:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901d84 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.635569:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901d84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.635584:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901d84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603992.635601:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787603992.636605:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901d76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636625:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901d76 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636633:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901d76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636640:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fe00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603992.636646:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901d76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636655:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901d76 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636674:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:1.0:1787603992.636677:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603992.636683:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901d76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636719:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901d76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636737:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901d7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636743:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901d7d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636749:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901d7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636754:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603992.636757:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901d7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636762:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901d7d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636771:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ed291bd5100) 00010000:00010000:1.0:1787603992.636773:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603992.636776:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901d7d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.636781:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901d7d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.639934:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901d6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5be0 expref: 16 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.639977:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901d84 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5be0 expref: 15 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603992.640003:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed290d35200) 00010000:00010000:1.0:1787603992.640007:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603992.640011:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e800, rc 0) 00000100:00100000:1.0:1787603992.640223:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:11293:x1874438345783936:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 7976us (9615us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787603992.640233:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 137 00000100:00100000:3.0:1787603992.645728:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603992.645793:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603992.645806:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345784064 00000100:00100000:0.0:1787603992.645823:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345784064 00000100:00100000:0.0:1787603992.646006:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 138 00000100:00100000:0.0:1787603992.646021:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:11293:x1874438345784064:12345-192.168.202.21@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787603992.646293:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:11293:x1874438345784064:12345-192.168.202.21@tcp:59:lhsmtool_posix.0 Request processed in 274us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603992.646301:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 138 00000100:00100000:2.0:1787603992.646432:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345784192 00000100:00100000:2.0:1787603992.646437:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345784192 00000100:00100000:2.0:1787603992.646483:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:2.0:1787603992.646492:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa48cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:2364:x1874438345784192:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603992.646507:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603992.646541:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901d84 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5be0 expref: 15 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603992.646581:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed290d35200) 00010000:00010000:2.0:1787603992.646588:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603992.646625:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa48cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:2364:x1874438345784192:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 135us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603992.649938:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 10 00010000:00010000:3.0:1787603992.986899:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787603993.149421:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:1.0:1787603993.239513:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787603993.239523:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787603993.240093:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787603993.240103:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787603993.560742:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355228160:0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.560882:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603993.560945:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355228672:0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.560975:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603993.561015:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787603993.561021:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355228288:0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.561044:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603993.561087:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355228160 00000100:00100000:0.0:1787603993.561096:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355228160 00000100:00100000:0.0:1787603993.561149:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355228288 00000100:00100000:0.0:1787603993.561152:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355228288 00000100:00100000:0.0:1787603993.561184:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787603993.561194:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355228160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.561262:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355228160:12345-0@lo:400:kworker.0 Request processed in 69us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603993.561270:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787603993.561289:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787603993.561296:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355228288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.561340:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355228288:12345-0@lo:400:kworker.0 Request processed in 45us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603993.561346:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787603993.561367:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355228672 00000100:00100000:0.0:1787603993.561370:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355228672 00000100:00100000:0.0:1787603993.561401:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787603993.561408:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355228672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.561440:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355228672:12345-0@lo:400:kworker.0 Request processed in 33us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603993.561447:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1787603993.561471:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787603993.561476:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787603993.561519:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355228288:0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.561531:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355228160:0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.561541:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355228672:0@lo:400:kworker.0 00000100:00100000:1.0:1787603993.561810:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355228416:0@lo:400:kworker.0 00000100:00100000:1.0:1787603993.561885:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603993.561907:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787603993.561914:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355228032:0@lo:400:kworker.0 00000100:00100000:1.0:1787603993.561945:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603993.561975:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355228544:0@lo:400:kworker.0 00000100:00100000:1.0:1787603993.562000:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603993.562834:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355228416 00000100:00100000:0.0:1787603993.562941:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355228416 00000100:00100000:0.0:1787603993.563011:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787603993.563021:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355228416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.563099:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355228416:12345-0@lo:400:kworker.0 Request processed in 79us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603993.563106:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787603993.563152:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355228416:0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.563182:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355228544 00000100:00100000:0.0:1787603993.563186:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355228544 00000100:00100000:0.0:1787603993.563231:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787603993.563238:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355228544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.563275:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355228544:12345-0@lo:400:kworker.0 Request processed in 39us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603993.563281:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787603993.563311:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355228544:0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.564823:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355228032 00000100:00080000:1.0:1787603993.565033:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787603993.565043:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787603993.565091:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355228032 00000100:00100000:0.0:1787603993.565169:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787603993.565181:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355228032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603993.565277:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355228032:12345-0@lo:400:kworker.0 Request processed in 99us (3331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603993.565285:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787603993.565345:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355228032:0@lo:400:kworker.0 00000100:00100000:1.0:1787603993.571067:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787603993.571100:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355228800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787603993.571206:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603993.571394:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355228800 00000100:00100000:3.0:1787603993.571405:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355228800 00000100:00100000:3.0:1787603993.571466:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787603993.571478:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355228800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787603993.571526:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603993.571598:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355228800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603993.571606:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787603993.571703:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355228800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787603994.008599:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603994.074566:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355228928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787603994.074652:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787603994.074888:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355228928 00000100:00100000:3.0:1787603994.074897:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355228928 00000100:00100000:3.0:1787603994.074952:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787603994.074962:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed295284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355228928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787603994.074996:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787603994.078092:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed295284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355228928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3120us (3429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603994.078107:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787603994.081990:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355228928:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787603995.032278:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603995.102583:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603995.102933:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345784320 00000100:00100000:1.0:1787603995.102944:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345784320 00000100:00100000:1.0:1787603995.103042:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 139 00000100:00100000:1.0:1787603995.103055:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:11335:x1874438345784320:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787603995.103078:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1787603995.103202:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787603995.103247:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901d92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5be7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.103388:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901d99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.103403:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901d99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.103415:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901d99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.103429:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901da0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.103436:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901da0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.103443:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901da0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.104478:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901d99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.104493:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901d99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.104500:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901d99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.104517:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603995.104523:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901d99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.104531:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901d99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.105201:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:1.0:1787603995.105204:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603995.105209:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901d99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.105215:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901d99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.105227:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901da0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.105233:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901da0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.105240:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901da0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.105245:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7ec00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603995.105248:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901da0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.105253:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901da0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.105338:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ed291bd5c00) 00010000:00010000:1.0:1787603995.105340:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603995.105343:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901da0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.105349:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901da0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.105395:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901d92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5be7 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.105406:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:1.0:1787603995.105408:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603995.105412:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901d92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5be7 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.105421:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f000, rc 0) 00000100:00100000:0.0:1787603995.110743:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:11335:x1874438345784320:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 7678us (8157us total) trans 0 rc 301/301 00000100:00100000:0.0:1787603995.110759:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 139 00000100:00100000:2.0:1787603995.118927:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603995.119015:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345784576 00000100:00100000:3.0:1787603995.119027:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345784576 00000100:00100000:2.0:1787603995.119312:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 140 00000100:00100000:2.0:1787603995.119327:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:11335:x1874438345784576:12345-192.168.202.21@tcp:36:lfs.0 00010000:00010000:2.0:1787603995.119393:0:7875:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603995.119423:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a1901710 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a20 expref: 13 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.119441:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:2.0:1787603995.119446:0:7875:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787603995.119759:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.119774:0:7875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901d68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bd9 expref: 5 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.119783:0:7875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.119820:0:7875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bd9 expref: 5 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.119866:0:7875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901d68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bd9 expref: 5 pid: 7875 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603995.119883:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355229056:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787603995.119980:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed298921cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603995.122881:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603995.122958:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345784704 00000100:00100000:1.0:1787603995.122967:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345784704 00010000:00010000:1.0:1787603995.123023:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901d68 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bd9 expref: 6 pid: 7875 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603995.123056:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 59 00000100:00100000:1.0:1787603995.123067:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:2364:x1874438345784704:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603995.123080:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603995.123213:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901d68 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bd9 expref: 6 pid: 7875 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.123242:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901d68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bd9 expref: 6 pid: 7875 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.123262:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:1.0:1787603995.123268:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.123276:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.123283:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.123301:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603995.123348:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:2364:x1874438345784704:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 283us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603995.123356:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 59 00000100:00080000:2.0:1787603995.123470:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787603995.123742:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901d68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bd9 expref: 5 pid: 7875 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603995.123759:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355229056:192.168.202.21@tcp:104: 00010000:00010000:3.0:1787603995.123780:0:7875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.123789:0:7875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.123807:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.123833:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901dae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.123870:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901dae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.123877:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901dae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787603995.129806:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787603995.129825:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.130036:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.130046:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.130053:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603995.130058:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.130065:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.130165:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed290d35300) 00010000:00010000:2.0:1787603995.130169:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603995.130175:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.130193:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1901da7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787603995.130215:0:7875:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffac9192 reply state 00000000ffef5657 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901dae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603995.130225:0:7875:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787603995.130372:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:11335:x1874438345784576:12345-192.168.202.21@tcp:36:lfs.0 Request processed in 11045us (11455us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787603995.130381:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 140 00010000:00010000:0.0:1787603995.142659:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901dae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.142676:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901dae lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.142685:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901dae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.142706:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dadc00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603995.142712:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901dae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.142720:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901dae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.142737:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ed290d35000) 00010000:00010000:0.0:1787603995.142740:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603995.142745:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901dae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.142752:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901dae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603995.273876:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.274365:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345784832 00000100:00100000:0.0:1787603995.274662:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345784832 00000100:00100000:0.0:1787603995.274727:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 141 00000100:00100000:0.0:1787603995.274737:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:11343:x1874438345784832:12345-192.168.202.21@tcp:101:lctl.0 00010000:00010000:0.0:1787603995.274765:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603995.274790:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901db5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5bee expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.274890:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901dbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.274904:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.274928:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603995.277117:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787603995.277128:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787603995.277194:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.277236:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901db5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bee expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.277257:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bee expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.277529:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b900) 00010000:00010000:0.0:1787603995.277542:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787603995.277546:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594a00, rc 0) 00000100:00100000:0.0:1787603995.277633:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:11343:x1874438345784832:12345-192.168.202.21@tcp:101:lctl.0 Request processed in 2895us (3766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603995.277642:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 141 00000100:00100000:3.0:1787603995.344304:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.344409:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345784960 00000100:00100000:0.0:1787603995.344418:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345784960 00000100:00100000:0.0:1787603995.344479:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 142 00000100:00100000:0.0:1787603995.344491:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+14:11349:x1874438345784960:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:0.0:1787603995.344511:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603995.344542:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901dc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5bf5 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344627:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901dca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344642:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901dca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344654:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901dca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344670:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901dd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344678:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344684:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344798:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901dd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344820:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344828:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603995.344906:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787603995.344910:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787603995.344936:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344959:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901dca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344965:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901dca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344971:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901dca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344977:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603995.344982:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901dca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.344989:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901dca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.345003:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b900) 00010000:00010000:0.0:1787603995.345007:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603995.345011:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901dca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.345017:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901dca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.345029:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.345034:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901dd1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.345040:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.345051:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603995.345054:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.345060:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901dd1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.345069:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ed28870be00) 00010000:00010000:0.0:1787603995.345071:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603995.345074:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901dd1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.345080:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901dd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.345111:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901dc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bf5 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.345126:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bf5 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.345133:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787603995.345135:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787603995.345137:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594600, rc 0) 00000100:00100000:0.0:1787603995.345193:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:11349:x1874438345784960:12345-192.168.202.21@tcp:101:bash.0 Request processed in 705us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603995.345200:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 142 00000100:00100000:3.0:1787603995.351825:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603995.351991:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345785216 00000100:00100000:1.0:1787603995.352002:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345785216 00000100:00100000:1.0:1787603995.352065:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 143 00000100:00100000:1.0:1787603995.352076:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+15:11349:x1874438345785216:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:1.0:1787603995.352098:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603995.352121:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901ddf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5bfc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.352269:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901de6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.352300:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901de6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.352311:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901de6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.352351:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901ded lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.352360:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901ded lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.352366:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901ded lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787603995.352977:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787603995.353146:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901df4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.353157:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.353165:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.353199:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901de6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.353207:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901de6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.353213:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901de6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.353227:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603995.353232:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901de6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.353239:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901de6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.353254:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:1.0:1787603995.353257:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603995.353263:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901de6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.353268:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901de6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787603995.353283:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc676d8f reply state 00000000a23bc532 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901ded lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603995.353292:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787603995.353324:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901ddf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bfc expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.353339:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bfc expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.353347:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5400) 00010000:00010000:1.0:1787603995.353349:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787603995.353352:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f600, rc 0) 00000100:00100000:1.0:1787603995.353422:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:11349:x1874438345785216:12345-192.168.202.21@tcp:101:bash.0 Request processed in 1347us (1607us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787603995.353436:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 143 00000100:00100000:1.0:1787603995.362011:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.362123:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345785344 00000100:00100000:0.0:1787603995.362151:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345785344 00000100:00100000:0.0:1787603995.362240:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 47 00000100:00100000:0.0:1787603995.362253:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2364:x1874438345785344:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:0.0:1787603995.362283:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603995.362311:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901e02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c03 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787603995.362345:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787603995.362368:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1787603995.362384:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787603995.362396:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901e02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c03 expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.362414:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901e02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c03 expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.362429:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594200, rc 0) 00000100:00100000:0.0:1787603995.362488:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345785344:12345-192.168.202.21@tcp:101:bash.0 Request processed in 238us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603995.362495:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 47 00000100:00080000:2.0:1787603995.362589:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787603995.362876:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901ded lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.362887:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901ded lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.362895:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901ded lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.362901:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603995.362906:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901ded lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.362916:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901ded lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.362930:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed291bd5c00) 00010000:00010000:3.0:1787603995.362941:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603995.362946:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901ded lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.362953:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901ded lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603995.367708:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.368004:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345785472 00000100:00100000:0.0:1787603995.368014:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345785472 00000100:00100000:0.0:1787603995.368071:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 48 00000100:00100000:0.0:1787603995.368257:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:11349:x1874438345785472:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:0.0:1787603995.368290:0:10671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603995.368315:0:10671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c0a expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.368483:0:10671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901e02 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c03 expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.368494:0:10671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787603995.368498:0:10671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787603995.368503:0:10671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 7 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.368550:0:10671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901e02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c03 expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.368565:0:10671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901e02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c03 expref: 7 pid: 6676 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603995.368579:0:10671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10671:1874438355229184:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603995.368673:0:10671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2901363c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787603995.371899:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603995.372011:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345785600 00000100:00100000:2.0:1787603995.372021:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345785600 00010000:00010000:2.0:1787603995.372063:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901e02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c03 expref: 8 pid: 6676 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603995.372113:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 60 00000100:00100000:2.0:1787603995.372123:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2363:x1874438345785600:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603995.372139:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603995.372164:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901e02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c03 expref: 8 pid: 6676 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.372179:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901e02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c03 expref: 8 pid: 6676 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.372204:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787603995.372222:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787603995.372231:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 8 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.372242:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 8 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.372299:0:6693:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 8 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603995.372316:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6693:1874438355229312:192.168.202.21@tcp:105: 00000100:00100000:2.0:1787603995.372657:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed282be2600 going to sleep for 11 seconds 00010000:00010000:0.0:1787603995.373064:0:10671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901e02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c03 expref: 8 pid: 6676 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603995.373097:0:10671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10671:1874438355229184:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603995.373124:0:10671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 7 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.373135:0:10671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594e00, rc 0) 00000100:00100000:0.0:1787603995.373200:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:11349:x1874438345785472:12345-192.168.202.21@tcp:101:bash.0 Request processed in 5120us (5504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603995.373209:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 48 00000100:00100000:2.0:1787603995.383743:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6693:1874438355229312:192.168.202.21@tcp:105: 00010000:00010000:2.0:1787603995.383775:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603995.383885:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345785600:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 11762us (11996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603995.383897:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 60 00000100:00100000:2.0:1787603995.387213:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603995.387414:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345785856 00000100:00100000:3.0:1787603995.387427:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345785856 00000100:00100000:3.0:1787603995.387494:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 36 00000100:00100000:3.0:1787603995.387505:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:11349:x1874438345785856:12345-192.168.202.21@tcp:35:bash.0 00000100:00100000:3.0:1787603995.387919:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:11349:x1874438345785856:12345-192.168.202.21@tcp:35:bash.0 Request processed in 413us (712us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787603995.387928:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 36 00000100:00100000:3.0:1787603995.491693:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.492132:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345786112 00000100:00100000:0.0:1787603995.492144:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345786112 00000100:00100000:0.0:1787603995.492210:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 144 00000100:00100000:0.0:1787603995.492221:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:11359:x1874438345786112:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603995.492248:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603995.492280:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901e10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c11 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603995.492651:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787603995.492779:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901e10 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c11 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.492795:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b900) 00010000:00010000:0.0:1787603995.492798:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787603995.492804:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901e10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c11 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.492818:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594200, rc 0) 00000100:00100000:0.0:1787603995.492947:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:11359:x1874438345786112:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 727us (1263us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787603995.492954:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 144 00000100:00100000:1.0:1787603995.497589:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603995.497678:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345786368 00000100:00100000:3.0:1787603995.497691:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345786368 00000100:00100000:3.0:1787603995.497752:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 37 00000100:00100000:3.0:1787603995.497763:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:11359:x1874438345786368:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:3.0:1787603995.498081:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:11359:x1874438345786368:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 319us (499us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787603995.498101:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 37 00000100:00100000:1.0:1787603995.579398:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.579570:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345786496 00000100:00100000:0.0:1787603995.579580:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345786496 00000100:00100000:0.0:1787603995.579652:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 145 00000100:00100000:0.0:1787603995.579664:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:11365:x1874438345786496:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603995.579705:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603995.579729:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c18 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.579804:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901e25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.579818:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.579829:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603995.579926:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787603995.579931:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787603995.579955:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.579983:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c18 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.580001:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901e25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c18 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.580010:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787603995.580012:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787603995.580016:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594200, rc 0) 00000100:00100000:0.0:1787603995.580079:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:11365:x1874438345786496:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 417us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603995.580087:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 145 00000100:00100000:0.0:1787603995.586195:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603995.586291:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345786752 00000100:00100000:3.0:1787603995.586301:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345786752 00000100:00100000:3.0:1787603995.586361:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 146 00000100:00100000:3.0:1787603995.586381:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:11365:x1874438345786752:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787603995.586417:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787603995.586437:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901e2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c1f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.586568:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901e33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.586583:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.586592:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787603995.586603:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787603995.586744:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1901e2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c1f expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.586765:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901e33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c1f expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603995.586774:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5400) 00010000:00010000:3.0:1787603995.586777:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787603995.586780:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dadc00, rc 0) 00000100:00100000:3.0:1787603995.586892:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:11365:x1874438345786752:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 520us (707us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787603995.586899:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 146 00000100:00100000:1.0:1787603995.592333:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.592521:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345786880 00000100:00100000:0.0:1787603995.592541:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345786880 00000100:00100000:0.0:1787603995.592610:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:0.0:1787603995.592621:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:2364:x1874438345786880:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787603995.592638:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603995.592663:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1901e33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c1f expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.592686:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5400) 00010000:00010000:0.0:1787603995.592692:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603995.592754:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:2364:x1874438345786880:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 134us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603995.592762:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:1.0:1787603995.594563:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.594649:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345787136 00000100:00100000:0.0:1787603995.594658:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345787136 00000100:00100000:0.0:1787603995.594709:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 147 00000100:00100000:0.0:1787603995.594719:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:11365:x1874438345787136:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603995.594743:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603995.594762:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c26 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.594882:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901e48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.594897:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.594925:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901e48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603995.594939:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787603995.595064:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c26 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.595102:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901e48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c26 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.595110:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5400) 00010000:00010000:0.0:1787603995.595113:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787603995.595116:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595c00, rc 0) 00000100:00100000:0.0:1787603995.595170:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:11365:x1874438345787136:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 452us (614us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787603995.595177:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 147 00000100:00100000:3.0:1787603995.602790:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.602873:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345787264 00000100:00100000:0.0:1787603995.602885:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345787264 00000100:00100000:0.0:1787603995.602948:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 49 00000100:00100000:0.0:1787603995.602959:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345787264:12345-192.168.202.21@tcp:1:lfs.0 00010000:00010000:0.0:1787603995.603001:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.603021:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 6 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.603029:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787603995.603048:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787603995.603053:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.603100:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 6 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.603115:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 6 pid: 10671 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603995.603130:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1874438355229440:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603995.603218:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed290136540 going to sleep for 11 seconds 00000100:00100000:3.0:1787603995.606339:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603995.606555:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345787392 00000100:00100000:2.0:1787603995.606565:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345787392 00002000:00100000:2.0:1787603995.606613:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ed286af0a80 x1874438345787392/t0(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:321/0 lens 504/0 e 0 to 0 dl 1787604006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787603995.606623:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed286af0a80 with x1874438345787392 ext(0->12) 00010000:00010000:2.0:1787603995.606631:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 7 pid: 10671 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.606665:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 7 pid: 10671 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787603995.606673:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed286af0a80 00000100:00100000:2.0:1787603995.606708:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 2 00000100:00100000:2.0:1787603995.606718:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345787392:12345-192.168.202.21@tcp:4:lfs.0 00000100:00100000:2.0:1787603995.607381:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2363:x1874438345787392:12345-192.168.202.21@tcp:4:lfs.0 Request processed in 662us (1049us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787603995.607390:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 2 00002000:00100000:2.0:1787603995.607398:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ed286af0a80 x1874438345787392/t4294967305(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:321/0 lens 504/448 e 0 to 0 dl 1787604006 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787603995.607407:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed286af0a80 with x1874438345787392 ext(0->12) 00010000:00010000:2.0:1787603995.607413:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 9 pid: 10671 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.607425:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 9 pid: 10671 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787603995.607431:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed286af0a80 00000100:00100000:0.0:1787603995.608173:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1874438355229440:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603995.608198:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603995.611064:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603995.611236:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345787520 00000100:00100000:1.0:1787603995.611248:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345787520 00010000:00010000:1.0:1787603995.611300:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 9 pid: 10671 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603995.611343:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 61 00000100:00100000:1.0:1787603995.611354:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2365:x1874438345787520:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603995.611378:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787603995.611398:0:5807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787603995.611400:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787603995 00002000:00010000:1.0:1787603995.611403:0:5807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787603995 00002000:00010000:1.0:1787603995.611405:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787603995 00010000:00010000:1.0:1787603995.611411:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 9 pid: 10671 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.611424:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 9 pid: 10671 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.611446:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1901e09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c0a expref: 9 pid: 10671 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.611487:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787603995.611492:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787603995.611499:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.611509:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.611557:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603995.611616:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2365:x1874438345787520:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 263us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603995.611624:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 61 00010000:00010000:0.0:1787603995.611701:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.611710:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.611735:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.611743:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.611758:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.611765:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787603995.611769:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.611778:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.611790:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.611796:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1901e56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603995.611899:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345787264:12345-192.168.202.21@tcp:1:lfs.0 Request processed in 8942us (9118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603995.611907:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 49 00000100:00100000:3.0:1787603995.617425:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.617589:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345787776 00000100:00100000:0.0:1787603995.617600:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345787776 00000100:00100000:0.0:1787603995.617655:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 38 00000100:00100000:0.0:1787603995.617666:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed291f93050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:11365:x1874438345787776:12345-192.168.202.21@tcp:35:lfs.0 00000004:00010000:0.0:1787603995.617733:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901e48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c26 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787603995.618185:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787603995.618230:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787603995.618897:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787603995.618957:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.618973:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901df4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bfc expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.618982:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.619017:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bfc expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.619032:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901df4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bfc expref: 28 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603995.619046:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1874438355229568:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603995.619153:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed290136540 going to sleep for 11 seconds 00000100:00100000:3.0:1787603995.623614:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.623802:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1874438355229568:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603995.623830:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603995.623969:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345787904 00000100:00100000:1.0:1787603995.623977:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345787904 00010000:00010000:1.0:1787603995.624012:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901df4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bfc expref: 29 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603995.624159:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 62 00000100:00100000:1.0:1787603995.624170:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:2364:x1874438345787904:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787603995.624186:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603995.624194:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901df4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bfc expref: 29 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.624206:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bfc expref: 29 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.624250:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901df4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bfc expref: 29 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.624265:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5400) 00010000:00010000:1.0:1787603995.624269:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.624279:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.624286:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.624318:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787603995.624386:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+28:2364:x1874438345787904:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 218us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603995.624394:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 62 00010000:00010000:0.0:1787603995.624861:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.624870:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787603995.625002:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787603995.625224:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787603995.625336:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1874438355229696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787603995.625397:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603995.625425:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2aa662600 going to sleep for 11 seconds 00000100:00100000:3.0:1787603995.626311:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355229696 00000100:00100000:3.0:1787603995.626320:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355229696 00000100:00100000:3.0:1787603995.626384:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787603995.626393:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1874438355229696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787603995.626479:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1874438355229696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603995.626486:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787603995.626709:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1874438355229696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787603995.627300:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787603995.627519:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1874438355229824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787603995.627574:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603995.627604:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed290136540 going to sleep for 11 seconds 00000100:00080000:2.0:1787603995.627671:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787603995.627720:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355229824 00000100:00100000:3.0:1787603995.627725:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355229824 00000100:00100000:3.0:1787603995.627761:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787603995.627770:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1874438355229824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787603995.627968:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5825:x1874438355229824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 199us (393us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787603995.627975:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787603995.628225:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1874438355229824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787603995.628283:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787603995.628333:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.628344:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.628351:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.628358:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603995.628362:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.628449:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.628468:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5400) 00010000:00010000:2.0:1787603995.628472:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787603995.628476:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.628482:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901e5d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787603995.628676:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787603995.628811:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787603995.628823:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328692985133ns, next at 329692983056ns, rc = 0 00000001:00080000:2.0:1787603995.628830:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787603995.628908:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5400) 00010000:00010000:2.0:1787603995.628911:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787603995.628918:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901e48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c26 expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603995.629027:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed291f93050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:11365:x1874438345787776:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 11362us (11610us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787603995.629035:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 38 00000020:00080000:2.0:1787603995.629040:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787603995.632321:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.632436:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345788032 00000100:00100000:0.0:1787603995.632448:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345788032 00000100:00100000:0.0:1787603995.632547:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 148 00000100:00100000:0.0:1787603995.632558:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:11365:x1874438345788032:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603995.632582:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603995.632604:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901e64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c2d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.632665:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c2d expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.632691:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c2d expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.632713:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:0.0:1787603995.632730:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787603995.632734:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595800, rc 0) 00000100:00100000:0.0:1787603995.632797:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:11365:x1874438345788032:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 241us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603995.632805:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 148 00000100:00100000:3.0:1787603995.635871:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603995.635957:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345788288 00000100:00100000:2.0:1787603995.635967:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345788288 00000100:00100000:2.0:1787603995.636018:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 39 00000100:00100000:2.0:1787603995.636027:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:11365:x1874438345788288:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:2.0:1787603995.636242:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+33:11365:x1874438345788288:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 216us (414us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787603995.636250:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 39 00000100:00100000:0.0:1787603995.722737:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603995.722921:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345788544 00000100:00100000:1.0:1787603995.722932:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345788544 00000100:00100000:1.0:1787603995.723052:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 149 00000100:00100000:1.0:1787603995.723065:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+33:11375:x1874438345788544:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787603995.723337:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603995.723362:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901e6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c34 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603995.723569:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787603995.723694:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901e6b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c34 expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.723728:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b900) 00010000:00010000:1.0:1787603995.723731:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787603995.723739:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1901e6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c34 expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603995.723756:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f600, rc 0) 00000100:00100000:1.0:1787603995.723931:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+34:11375:x1874438345788544:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 869us (1209us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787603995.723938:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 149 00000100:00100000:1.0:1787603995.727824:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603995.728064:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345788672 00000100:00100000:2.0:1787603995.728486:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345788672 00000100:00100000:2.0:1787603995.728609:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 150 00000100:00100000:2.0:1787603995.728622:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+34:11375:x1874438345788672:12345-192.168.202.21@tcp:34:lfs.0 00010000:00010000:2.0:1787603995.728704:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901e79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.728722:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.728734:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.728751:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901e80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.728783:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901e80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.728790:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901e80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.728966:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.728975:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.728982:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787603995.729023:0:7875:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729035:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729041:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901e79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729047:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729054:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603995.729057:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729064:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901e79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729103:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:2.0:1787603995.729107:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603995.729112:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901e79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729119:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1901e79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729133:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901e80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729140:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901e80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729145:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901e80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729150:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603995.729153:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901e80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729159:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901e80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729166:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed2b2e8b200) 00010000:00010000:2.0:1787603995.729168:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603995.729171:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901e80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729177:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1901e80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729202:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729209:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901e87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729214:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729220:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963a00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603995.729222:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729229:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901e87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729236:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:2.0:1787603995.729239:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603995.729242:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901e87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603995.729247:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1901e87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603995.729344:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+34:11375:x1874438345788672:12345-192.168.202.21@tcp:34:lfs.0 Request processed in 724us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603995.729353:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 150 00000100:00100000:1.0:1787603995.732680:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603995.732806:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345788928 00000100:00100000:3.0:1787603995.732818:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345788928 00000100:00100000:3.0:1787603995.732901:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 40 00000100:00100000:3.0:1787603995.732912:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+34:11375:x1874438345788928:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:3.0:1787603995.733180:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+35:11375:x1874438345788928:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 268us (508us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787603995.733188:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 40 00000100:00100000:3.0:1787603995.786628:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.786826:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345789184 00000100:00100000:0.0:1787603995.786878:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345789184 00000100:00100000:0.0:1787603995.786939:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 151 00000100:00100000:0.0:1787603995.786950:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+35:11378:x1874438345789184:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603995.786975:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603995.786996:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901e8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c3b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787090:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901e95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787103:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901e95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787115:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901e95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787130:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901e9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787138:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787144:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787296:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ea3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787304:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787311:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603995.787320:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787603995.787417:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901e95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787424:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901e95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787431:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901e95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787436:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603995.787441:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901e95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787448:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901e95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787460:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787603995.787462:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603995.787467:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901e95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787484:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901e95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787499:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787504:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901e9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787510:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787515:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603995.787518:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787524:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901e9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787542:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed28870b700) 00010000:00010000:0.0:1787603995.787544:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603995.787547:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901e9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787553:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901e9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787594:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901e8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c3b expref: 38 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787609:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c3b expref: 37 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.787624:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:0.0:1787603995.787626:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787603995.787629:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594000, rc 0) 00000100:00100000:0.0:1787603995.787710:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:11378:x1874438345789184:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 761us (1090us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787603995.787717:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 151 00000100:00100000:1.0:1787603995.793082:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603995.793167:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345789312 00000100:00100000:0.0:1787603995.793178:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345789312 00000100:00100000:0.0:1787603995.793240:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 152 00000100:00100000:0.0:1787603995.793251:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:11378:x1874438345789312:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:0.0:1787603995.793337:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901eb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.793355:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.793365:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.793406:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.793413:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901eb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.793420:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.793426:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595c00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603995.793447:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.793454:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901eb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.793465:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:0.0:1787603995.793469:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787603995.793473:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901eb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603995.793479:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901eb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603995.793567:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:11378:x1874438345789312:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 317us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603995.793575:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 152 00000100:00100000:2.0:1787603995.798117:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603995.798269:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345789568 00000100:00100000:3.0:1787603995.798282:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345789568 00000100:00100000:3.0:1787603995.798362:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 41 00000100:00100000:3.0:1787603995.798379:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:11378:x1874438345789568:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:3.0:1787603995.798628:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+38:11378:x1874438345789568:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 249us (520us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787603995.798636:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 41 00010000:00010000:3.0:1787603996.055725:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787603996.130346:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603996.130445:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345789824 00000100:00100000:0.0:1787603996.130455:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345789824 00000100:00100000:0.0:1787603996.130562:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 153 00000100:00100000:0.0:1787603996.130575:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+38:11409:x1874438345789824:12345-192.168.202.21@tcp:101:cat.0 00010000:00010000:0.0:1787603996.130609:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603996.130630:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901eb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c42 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.130728:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901ebf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.130743:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.130770:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603996.130780:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787603996.130919:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901eb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c42 expref: 41 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.131123:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901ebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c42 expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.131132:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:0.0:1787603996.131134:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787603996.131137:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594400, rc 0) 00000100:00100000:0.0:1787603996.131195:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+40:11409:x1874438345789824:12345-192.168.202.21@tcp:101:cat.0 Request processed in 623us (859us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787603996.131202:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 153 00000100:00100000:1.0:1787603996.145904:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603996.146208:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603996.146687:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345790208 00000100:00100000:3.0:1787603996.146698:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345790208 00000100:00100000:3.0:1787603996.146752:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 42 00000100:00100000:3.0:1787603996.146763:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+40:11409:x1874438345790208:12345-192.168.202.21@tcp:35:cat.0 00000100:00100000:3.0:1787603996.147307:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+41:11409:x1874438345790208:12345-192.168.202.21@tcp:35:cat.0 Request processed in 545us (1097us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787603996.147316:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 42 00000100:00100000:2.0:1787603996.148142:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345789952 00000100:00100000:2.0:1787603996.148151:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345789952 00000100:00100000:2.0:1787603996.148226:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:2.0:1787603996.148236:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+41:2364:x1874438345789952:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603996.148248:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603996.148283:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901ebf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c42 expref: 41 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.148305:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:2.0:1787603996.148311:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603996.148356:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+40:2364:x1874438345789952:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 121us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603996.148363:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:1.0:1787603996.235963:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603996.236067:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345790464 00000100:00100000:0.0:1787603996.236077:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345790464 00000100:00100000:0.0:1787603996.236151:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 154 00000100:00100000:0.0:1787603996.236163:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+40:11414:x1874438345790464:12345-192.168.202.21@tcp:101:dd.0 00010000:00010000:0.0:1787603996.236186:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603996.236189:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787603996.236214:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901e25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c18 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.236234:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787603996.236252:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787603996.236277:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901ecd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c49 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.236379:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.236393:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ea3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c3b expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.236402:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.236434:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c3b expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.236448:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c3b expref: 40 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603996.236461:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355229952:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603996.236568:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed290136a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787603996.240688:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355229952:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603996.240719:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603996.243400:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603996.243503:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345790592 00000100:00100000:2.0:1787603996.243513:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345790592 00010000:00010000:2.0:1787603996.243563:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c3b expref: 41 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603996.243606:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 63 00000100:00100000:2.0:1787603996.243618:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa48fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+41:2365:x1874438345790592:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603996.243634:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603996.243641:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c3b expref: 41 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.243655:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c3b expref: 41 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.243675:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ea3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c3b expref: 41 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.243712:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:2.0:1787603996.243717:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.243726:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.243734:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.243768:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603996.243822:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa48fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+40:2365:x1874438345790592:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 207us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603996.243830:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 63 00010000:00010000:0.0:1787603996.243969:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.243978:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603996.244004:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787603996.244157:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901ecd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c49 expref: 41 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.244173:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c49 expref: 40 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.244181:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:0.0:1787603996.244183:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787603996.244186:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594800, rc 0) 00000100:00100000:0.0:1787603996.244214:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+40:11414:x1874438345790464:12345-192.168.202.21@tcp:101:dd.0 Request processed in 8053us (8261us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787603996.244221:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 154 00000100:00100000:1.0:1787603996.247816:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603996.247982:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345790848 00000100:00100000:0.0:1787603996.247992:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345790848 00000100:00100000:0.0:1787603996.248040:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 155 00000100:00100000:0.0:1787603996.248050:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+40:11414:x1874438345790848:12345-192.168.202.21@tcp:36:dd.0 00010000:00010000:0.0:1787603996.248323:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ee2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.248338:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603996.248348:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787603996.248412:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1787603996.248449:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f68c578 reply state 00000000f7ef8e1d transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603996.248458:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787603996.248689:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+43:11414:x1874438345790848:12345-192.168.202.21@tcp:36:dd.0 Request processed in 638us (880us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787603996.248697:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 155 00000020:00080000:0.0:1787603996.248702:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787603996.260672:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.260692:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ee2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.260701:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.260708:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603996.260713:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.260721:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ee2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.260758:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:3.0:1787603996.260761:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603996.260765:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ee2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.260771:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901ee2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603996.478284:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603996.478334:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603996.478373:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603996.478403:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603996.478413:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345791104 00000100:00100000:2.0:1787603996.478424:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345791104 00000100:00100000:1.0:1787603996.478427:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345791360 00000100:00100000:1.0:1787603996.478430:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345791360 00000100:00100000:2.0:1787603996.478473:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345791232 00000100:00100000:2.0:1787603996.478475:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345791232 00000100:00100000:1.0:1787603996.478477:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 152 00000100:00100000:1.0:1787603996.478501:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2364:x1874438345791360:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603996.478504:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 70 00000100:00100000:2.0:1787603996.478511:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2364:x1874438345791104:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787603996.478585:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2364:x1874438345791104:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603996.478593:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 70 00000100:00100000:3.0:1787603996.478599:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345790976 00000100:00100000:3.0:1787603996.478603:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345790976 00000100:00100000:2.0:1787603996.478609:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 71 00000100:00100000:2.0:1787603996.478615:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345791232:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787603996.478643:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 295 00000100:00100000:3.0:1787603996.478651:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2364:x1874438345790976:12345-192.168.202.21@tcp:400:kworker.0 00000100:00080000:0.0:1787603996.478755:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787603996.489435:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2364:x1874438345791360:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 10936us (11017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603996.489452:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 152 00000100:00100000:2.0:1787603996.500326:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2364:x1874438345791232:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 21697us (21947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603996.500357:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 71 00000100:00100000:3.0:1787603996.501272:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2364:x1874438345790976:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 22612us (22989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603996.501286:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 295 00000100:00100000:3.0:1787603996.618608:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603996.623763:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345791488 00000100:00100000:0.0:1787603996.623779:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345791488 00000100:00100000:2.0:1787603996.624503:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 156 00000100:00100000:2.0:1787603996.624528:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+42:11429:x1874438345791488:12345-192.168.202.21@tcp:101:stat.0 00010000:00010000:2.0:1787603996.624557:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603996.624581:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1901ee9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c50 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.624652:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a1901ef0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.624666:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a1901ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.624678:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a1901ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.624694:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901ef7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.624702:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.624709:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.624816:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901efe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.624828:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c49 expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.624900:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901efe lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.624944:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c49 expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.625096:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c49 expref: 43 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603996.625110:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1874438355230080:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787603996.625315:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed282be2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787603996.634652:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1874438355230080:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787603996.634692:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901efe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603996.640878:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603996.640987:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345791744 00000100:00100000:1.0:1787603996.640999:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345791744 00000100:00100000:1.0:1787603996.641058:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 43 00000100:00100000:1.0:1787603996.641069:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+44:5606:x1874438345791744:12345-192.168.202.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787603996.641441:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+45:5606:x1874438345791744:12345-192.168.202.21@tcp:35:ldlm_bl.0 Request processed in 373us (613us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787603996.641450:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 43 00000100:00100000:3.0:1787603996.655491:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603996.656123:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345791872 00000100:00100000:3.0:1787603996.656137:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345791872 00010000:00010000:3.0:1787603996.656197:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c49 expref: 45 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603996.656257:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 64 00000100:00100000:3.0:1787603996.656270:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+45:2363:x1874438345791872:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787603996.656288:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603996.656297:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c49 expref: 45 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.656332:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c49 expref: 45 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.656374:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901ed4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c49 expref: 45 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.656397:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:3.0:1787603996.656404:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901efe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.656416:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.656424:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901efe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.656450:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603996.656502:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+44:2363:x1874438345791872:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 234us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603996.656509:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 64 00010000:00010000:2.0:1787603996.660945:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.660973:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787603996.661023:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787603996.661028:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787603996.661050:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661066:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901efe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661087:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a1901ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661094:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a1901ef0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661101:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a1901ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661107:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603996.661112:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a1901ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661119:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a1901ef0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661135:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:2.0:1787603996.661138:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603996.661142:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a1901ef0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661148:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a1901ef0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661161:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661168:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661173:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661183:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603996.661186:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661192:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661200:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed2b2e8b200) 00010000:00010000:2.0:1787603996.661203:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603996.661206:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901ef7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661211:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901ef7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661260:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1901ee9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c50 expref: 44 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661276:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901efe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c50 expref: 43 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603996.661284:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:2.0:1787603996.661286:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787603996.661289:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962800, rc 0) 00000100:00100000:2.0:1787603996.661638:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+43:11429:x1874438345791488:12345-192.168.202.21@tcp:101:stat.0 Request processed in 36842us (42759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603996.661649:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 156 00000001:00080000:2.0:1787603996.707501:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1787603996.707553:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1787603996.744340:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603996.744558:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345792128 00000100:00100000:0.0:1787603996.744569:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345792128 00000100:00100000:1.0:1787603996.744742:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 157 00000100:00100000:1.0:1787603996.744757:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+43:11435:x1874438345792128:12345-192.168.202.21@tcp:36:truncate.0 00010000:00010000:1.0:1787603996.744821:0:7875:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787603996.744890:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1901efe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c50 expref: 43 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603996.744910:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:1.0:1787603996.744915:0:7875:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787603996.745133:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901f05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603996.745147:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901f05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603996.745156:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901f05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787603996.745225:0:7875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787603996.745725:0:7875:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000121e8000 reply state 000000003c45a348 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901f05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603996.745738:0:7875:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787603996.745891:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+45:11435:x1874438345792128:12345-192.168.202.21@tcp:36:truncate.0 Request processed in 1137us (1562us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787603996.745899:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 157 00000020:00080000:1.0:1787603996.745905:0:7875:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787603996.768121:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901f05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.768140:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901f05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.768149:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901f05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.768180:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603996.768185:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901f05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.768193:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901f05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.768215:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:3.0:1787603996.768218:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787603996.768223:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901f05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603996.768228:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1901f05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603997.026371:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603997.026592:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345792256 00000100:00100000:1.0:1787603997.026604:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345792256 00000100:00100000:1.0:1787603997.026696:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 158 00000100:00100000:1.0:1787603997.026707:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+44:11450:x1874438345792256:12345-192.168.202.21@tcp:101:stat.0 00010000:00010000:1.0:1787603997.026731:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603997.026752:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901f0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c57 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.026827:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.026882:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.026898:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.026913:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.026944:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.026951:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027052:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027060:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027067:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603997.027119:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787603997.027123:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787603997.027150:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027164:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027172:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027179:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027185:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027201:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603997.027206:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027216:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027230:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:1.0:1787603997.027233:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603997.027237:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027242:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027256:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027262:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027268:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027273:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fe00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603997.027275:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027281:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027298:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed291bd5a00) 00010000:00010000:1.0:1787603997.027301:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603997.027304:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027310:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027345:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901f0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c57 expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027371:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c57 expref: 45 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.027379:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:1.0:1787603997.027382:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787603997.027384:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f400, rc 0) 00000100:00100000:1.0:1787603997.027448:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+45:11450:x1874438345792256:12345-192.168.202.21@tcp:101:stat.0 Request processed in 742us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603997.027455:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 158 00000100:00080000:0.0:1787603997.027825:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787603997.082796:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787603997.144738:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603997.144868:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345792512 00000100:00100000:0.0:1787603997.144880:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345792512 00000100:00100000:0.0:1787603997.144960:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 159 00000100:00100000:0.0:1787603997.144971:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+45:11460:x1874438345792512:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603997.144995:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603997.145017:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c5e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603997.145145:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787603997.145283:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c5e expref: 47 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.145299:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b900) 00010000:00010000:0.0:1787603997.145302:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787603997.145307:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c5e expref: 47 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.145337:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594e00, rc 0) 00000100:00100000:0.0:1787603997.145400:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+46:11460:x1874438345792512:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 431us (676us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787603997.145408:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 159 00000100:00100000:3.0:1787603997.153030:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603997.156946:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345792768 00000100:00100000:1.0:1787603997.156963:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345792768 00000100:00100000:1.0:1787603997.157042:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 44 00000100:00100000:1.0:1787603997.157053:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed291f92c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+46:11460:x1874438345792768:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:1.0:1787603997.157338:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed291f92c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+47:11460:x1874438345792768:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 285us (4318us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787603997.157346:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 44 00000100:00100000:3.0:1787603997.271113:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603997.271210:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345793024 00000100:00100000:1.0:1787603997.271221:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345793024 00000100:00100000:1.0:1787603997.271293:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 160 00000100:00100000:1.0:1787603997.271302:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+47:11466:x1874438345793024:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:1.0:1787603997.271324:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603997.271344:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901f36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c65 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.271458:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.271473:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c57 expref: 48 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.271481:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.271527:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c57 expref: 48 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.271540:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c57 expref: 48 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603997.271553:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355230208:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787603997.271640:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295142840 going to sleep for 11 seconds 00000100:00100000:3.0:1787603997.279800:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603997.279912:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345793152 00000100:00100000:2.0:1787603997.279936:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345793152 00010000:00010000:2.0:1787603997.279982:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c57 expref: 49 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603997.280029:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 65 00000100:00100000:2.0:1787603997.280039:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290176d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:2364:x1874438345793152:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603997.280053:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603997.280059:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c57 expref: 49 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.280073:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c57 expref: 49 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.280095:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:2.0:1787603997.280100:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.280108:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.280115:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.280132:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603997.280184:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290176d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+49:2364:x1874438345793152:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 146us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603997.280206:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 65 00010000:00010000:1.0:1787603997.280698:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a1901f21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c57 expref: 48 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603997.280718:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355230208:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603997.280750:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.280760:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.280765:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603997.280784:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787603997.281190:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1901f36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c65 expref: 49 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.281207:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c65 expref: 48 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.281215:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:1.0:1787603997.281217:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787603997.281220:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7fe00, rc 0) 00000100:00100000:1.0:1787603997.281533:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+48:11466:x1874438345793024:12345-192.168.202.21@tcp:101:bash.0 Request processed in 10231us (10427us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787603997.281541:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 160 00000100:00100000:3.0:1787603997.300623:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603997.300727:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345793408 00000100:00100000:0.0:1787603997.300741:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345793408 00000100:00100000:0.0:1787603997.300809:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 161 00000100:00100000:0.0:1787603997.300822:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+48:11466:x1874438345793408:12345-192.168.202.21@tcp:36:bash.0 00010000:00010000:0.0:1787603997.301171:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.301190:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.301202:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787603997.301259:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787603997.301282:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016bd880b reply state 0000000079ad989c transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603997.301291:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787603997.301394:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:11466:x1874438345793408:12345-192.168.202.21@tcp:36:bash.0 Request processed in 574us (781us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787603997.301402:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 161 00000020:00080000:0.0:1787603997.301407:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787603997.310721:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.310766:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.310774:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.310781:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603997.310787:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.310795:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.310815:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:0.0:1787603997.310819:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603997.310825:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.310832:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603997.324134:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603997.324952:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345793536 00000100:00100000:2.0:1787603997.324964:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345793536 00000100:00100000:2.0:1787603997.325032:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 162 00000100:00100000:2.0:1787603997.325046:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:11466:x1874438345793536:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:2.0:1787603997.325073:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787603997.325097:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1901f52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c6c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.325192:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.325210:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c65 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.325219:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901f59 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.325256:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c65 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.325269:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c65 expref: 51 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603997.325282:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1874438355230336:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787603997.325373:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed282be2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787603997.329143:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603997.329465:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1874438355230336:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787603997.329506:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603997.333882:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345793664 00000100:00100000:0.0:1787603997.333904:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345793664 00010000:00010000:2.0:1787603997.334413:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c65 expref: 52 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603997.334472:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 66 00000100:00100000:2.0:1787603997.334484:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:2363:x1874438345793664:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603997.334502:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603997.334509:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c65 expref: 52 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.334535:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c65 expref: 52 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.334557:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1901f3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c65 expref: 52 pid: 5822 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.334575:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:2.0:1787603997.334581:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.334591:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.334598:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901f59 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.334634:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603997.334716:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:2363:x1874438345793664:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 234us (5584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603997.334725:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 66 00010000:00010000:0.0:1787603997.335253:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.335263:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603997.335314:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787603997.335319:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787603997.335352:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.335388:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1901f52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c6c expref: 51 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.335405:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901f59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c6c expref: 50 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.335413:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:0.0:1787603997.335417:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787603997.335419:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963200, rc 0) 00000100:00100000:0.0:1787603997.336525:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:11466:x1874438345793536:12345-192.168.202.21@tcp:101:bash.0 Request processed in 11466us (12385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603997.336537:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 162 00000100:00100000:3.0:1787603997.353494:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603997.353758:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345793920 00000100:00100000:1.0:1787603997.353769:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345793920 00000100:00100000:1.0:1787603997.353829:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 45 00000100:00100000:1.0:1787603997.353886:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:11466:x1874438345793920:12345-192.168.202.21@tcp:35:bash.0 00000100:00100000:1.0:1787603997.354284:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:11466:x1874438345793920:12345-192.168.202.21@tcp:35:bash.0 Request processed in 444us (799us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787603997.354308:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 45 00000100:00100000:1.0:1787603997.475211:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603997.475384:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345794176 00000100:00100000:0.0:1787603997.475396:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345794176 00000100:00100000:0.0:1787603997.475459:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 163 00000100:00100000:0.0:1787603997.475470:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:11476:x1874438345794176:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603997.475492:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603997.475546:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c73 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603997.475666:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787603997.475805:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f60 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c73 expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.475820:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b900) 00010000:00010000:0.0:1787603997.475834:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787603997.475878:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c73 expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.475893:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594e00, rc 0) 00000100:00100000:0.0:1787603997.475962:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:11476:x1874438345794176:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 493us (762us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787603997.475968:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 163 00000100:00100000:2.0:1787603997.481558:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603997.481654:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345794304 00000100:00100000:1.0:1787603997.481665:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345794304 00000100:00100000:1.0:1787603997.481725:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 164 00000100:00100000:1.0:1787603997.481737:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:11476:x1874438345794304:12345-192.168.202.21@tcp:34:lfs.0 00010000:00010000:1.0:1787603997.481822:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.481862:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.481874:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.481893:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901f75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.481900:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.481907:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482011:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901f7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482020:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482027:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787603997.482100:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482113:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482119:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482126:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482132:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603997.482136:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482144:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482156:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:1.0:1787603997.482159:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603997.482163:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482169:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901f6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482182:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482188:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901f75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482203:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901f75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482209:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603997.482212:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901f75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482217:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901f75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482225:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed291bd5a00) 00010000:00010000:1.0:1787603997.482227:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603997.482230:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901f75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482235:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1901f75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482249:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482255:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901f7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482260:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901f7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482264:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603997.482267:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901f7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482283:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901f7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482291:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:1.0:1787603997.482294:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787603997.482296:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901f7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.482302:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1901f7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603997.482378:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:11476:x1874438345794304:12345-192.168.202.21@tcp:34:lfs.0 Request processed in 642us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603997.482385:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 164 00000100:00100000:3.0:1787603997.489436:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603997.489612:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345794560 00000100:00100000:2.0:1787603997.489625:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345794560 00000100:00100000:2.0:1787603997.489688:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 46 00000100:00100000:2.0:1787603997.489700:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:11476:x1874438345794560:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:2.0:1787603997.490035:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+53:11476:x1874438345794560:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 336us (611us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787603997.490044:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 46 00000100:00100000:3.0:1787603997.553913:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603997.554033:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345794816 00000100:00100000:0.0:1787603997.554046:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345794816 00000100:00100000:0.0:1787603997.554129:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 165 00000100:00100000:0.0:1787603997.554143:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+53:11479:x1874438345794816:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603997.554173:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603997.554200:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c7a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554312:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901f8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554331:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901f8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554342:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901f8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554370:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901f91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554377:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554402:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554558:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901f98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554568:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901f98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554576:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901f98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603997.554585:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787603997.554686:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901f8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554694:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901f8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554700:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901f8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554705:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603997.554709:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901f8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554717:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901f8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554729:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787603997.554733:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603997.554746:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901f8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554751:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a1901f8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554765:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901f91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554771:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901f91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554776:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901f91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554780:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603997.554783:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901f91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554791:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901f91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554799:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed28870b200) 00010000:00010000:0.0:1787603997.554801:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603997.554804:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901f91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.554808:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901f91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.555062:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901f83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c7a expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.555093:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901f98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c7a expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.555100:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:0.0:1787603997.555103:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787603997.555106:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595e00, rc 0) 00000100:00100000:0.0:1787603997.555173:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:11479:x1874438345794816:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 1034us (1273us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787603997.555181:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 165 00000100:00100000:1.0:1787603997.563656:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603997.563703:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603997.563806:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345795072 00000100:00100000:2.0:1787603997.563821:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345795072 00000100:00100000:2.0:1787603997.563933:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:2.0:1787603997.563946:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:2365:x1874438345795072:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603997.563962:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603997.563987:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1901f98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c7a expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.564007:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:2.0:1787603997.564012:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603997.564072:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:2365:x1874438345795072:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 129us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603997.564080:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:0.0:1787603997.565808:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345794944 00000100:00100000:0.0:1787603997.565823:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345794944 00000100:00100000:0.0:1787603997.565915:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 166 00000100:00100000:0.0:1787603997.565927:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:11479:x1874438345794944:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:0.0:1787603997.566005:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901fa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.566023:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.566035:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.566062:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.566069:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.566112:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.566118:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603997.566123:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.566132:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.566144:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:0.0:1787603997.566148:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787603997.566152:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901fa6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.566158:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901fa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603997.566233:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:11479:x1874438345794944:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 308us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603997.566241:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 166 00000100:00100000:1.0:1787603997.568833:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603997.568978:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345795328 00000100:00100000:3.0:1787603997.568988:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345795328 00000100:00100000:3.0:1787603997.569047:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 47 00000100:00100000:3.0:1787603997.569057:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:11479:x1874438345795328:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:3.0:1787603997.569342:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:11479:x1874438345795328:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 286us (520us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787603997.569349:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 47 00000100:00100000:1.0:1787603997.802193:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603997.802463:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345795584 00000100:00100000:0.0:1787603997.802474:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345795584 00000100:00100000:0.0:1787603997.802549:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 167 00000100:00100000:0.0:1787603997.802560:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:11497:x1874438345795584:12345-192.168.202.21@tcp:101:cat.0 00010000:00010000:0.0:1787603997.802590:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603997.802628:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901fad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c81 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.802754:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901fb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.802769:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.802782:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603997.802794:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787603997.802961:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1901fad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c81 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.802979:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c81 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.802988:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:0.0:1787603997.802991:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787603997.802994:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594e00, rc 0) 00000100:00100000:0.0:1787603997.803065:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+57:11497:x1874438345795584:12345-192.168.202.21@tcp:101:cat.0 Request processed in 507us (882us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787603997.803073:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 167 00000100:00100000:0.0:1787603997.853241:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603997.853471:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345795712 00000100:00100000:1.0:1787603997.853482:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345795712 00000100:00100000:1.0:1787603997.853555:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 168 00000100:00100000:1.0:1787603997.853567:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+57:11498:x1874438345795712:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787603997.853590:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603997.853610:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901fc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c88 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.853707:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901fc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.853731:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.853743:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603997.853813:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787603997.853817:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787603997.853873:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.853901:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1901fc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c88 expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.853921:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c88 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603997.853930:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:1.0:1787603997.853933:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787603997.853937:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7ec00, rc 0) 00000100:00100000:1.0:1787603997.854053:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+58:11498:x1874438345795712:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 487us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603997.854060:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 168 00000100:00100000:2.0:1787603997.861941:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603997.862026:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345796096 00000100:00100000:3.0:1787603997.862037:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345796096 00000100:00100000:3.0:1787603997.862105:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 48 00000100:00100000:3.0:1787603997.862117:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+58:11498:x1874438345796096:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:3.0:1787603997.862692:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:11498:x1874438345796096:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 574us (759us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787603997.862700:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 48 00000100:00100000:3.0:1787603997.866802:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603997.866944:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345796224 00000100:00100000:2.0:1787603997.866966:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345796224 00000100:00100000:2.0:1787603997.867038:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00100000:2.0:1787603997.867049:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:11498:x1874438345796224:12345-192.168.202.21@tcp:103:lfs.0 00010000:00010000:2.0:1787603997.867066:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787603997.867091:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901f59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c6c expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.867112:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a1901fb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c81 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.867124:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1901e64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c2d expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.867135:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:2.0:1787603997.867146:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603997.867271:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:11498:x1874438345796224:12345-192.168.202.21@tcp:103:lfs.0 Request processed in 222us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603997.867279:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00100000:0.0:1787603997.879152:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603997.879235:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345796352 00000100:00100000:2.0:1787603997.879254:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345796352 00000100:00100000:2.0:1787603997.879316:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 169 00000100:00100000:2.0:1787603997.879327:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:11498:x1874438345796352:12345-192.168.202.21@tcp:58:lfs.0 00010000:00010000:2.0:1787603997.879468:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901fd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.879487:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901fd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603997.879524:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901fd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787603997.879732:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787603997.879827:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:11498:x1874438345796352:12345-192.168.202.21@tcp:58:lfs.0 Request processed in 500us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603997.879835:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 169 00000100:00100000:1.0:1787603997.918231:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603997.918387:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345796480 00000100:00100000:0.0:1787603997.918399:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345796480 00000100:00100000:0.0:1787603997.918472:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 170 00000100:00100000:0.0:1787603997.918484:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:11500:x1874438345796480:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787603997.918562:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603997.918589:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901fd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c8f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918670:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901fde lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918690:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901fde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918703:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901fde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918718:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901fe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918726:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918733:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918833:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918874:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918881:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603997.918917:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787603997.918926:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787603997.918946:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918958:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918967:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901fde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918973:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901fde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918980:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901fde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918986:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603997.918990:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901fde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.918998:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901fde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.919011:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787603997.919014:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603997.919018:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901fde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.919025:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901fde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.919037:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.919053:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901fe5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.919059:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.919064:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603997.919067:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.919073:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.919080:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed28870b200) 00010000:00010000:0.0:1787603997.919082:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603997.919084:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901fe5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.919090:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1901fe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.919122:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1901fd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c8f expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.919134:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c8f expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603997.919141:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed2b2e8b200) 00010000:00010000:0.0:1787603997.919144:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787603997.919152:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595c00, rc 0) 00000100:00100000:0.0:1787603997.919215:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+57:11500:x1874438345796480:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 734us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603997.919223:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 170 00010000:00010000:2.0:1787603998.103189:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787603998.222770:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000020:00080000:2.0:1787603998.222818:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2aa662480 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787603998.222823:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed285e8d700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2aa662600 00000020:00080000:2.0:1787603998.222827:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed285e8da00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2ba1db800 00000004:00080000:2.0:1787603998.222904:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:2.0:1787603998.222923:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:2.0:1787603998.222947:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787603998.223117:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787603998.224095:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355230464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787603998.224167:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603998.224311:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355230464 00000100:00100000:0.0:1787603998.224320:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355230464 00000100:00100000:0.0:1787603998.224377:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787603998.224388:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355230464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787603998.224420:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1787603998.224455:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8cac1b, atime: 0x6a8cac1b, ctime: 0x6a8cac1b, blocks: 0xb 00010000:00010000:0.0:1787603998.224464:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901ff3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.224482:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1787603998.224486:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787603998.224493:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.224519:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.224529:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.224536:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901ff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.224568:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787603998.225122:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1874438355230464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 733us (952us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787603998.225132:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1787603998.225160:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787603998.225175:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787603998.225182:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901ff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.225192:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787603998.225197:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901ff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.225207:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901ff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.225225:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901ff3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.225232:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a1901ff3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.225707:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603998.225710:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603998.225712:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603998.225743:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1787603998.225755:0:3284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1787603998.225776:0:3284:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed2ba1a9c00 x1874438355230464/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787604014 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787603998.225788:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2ba1a9c00/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787603998.225793:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355230464:0@lo:6:osp-syn-0-0.0 00000040:00080000:2.0:1787603998.359053:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787603998.359065:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787603998.359110:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787603998.359117:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787603998.359255:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874438355230592:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787603998.359738:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2871c2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787603998.368876:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874438355230592:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787603998.384319:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603998.384411:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345796608 00000100:00100000:1.0:1787603998.384421:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345796608 00000100:00100000:1.0:1787603998.384490:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 171 00000100:00100000:1.0:1787603998.384501:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:11511:x1874438345796608:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787603998.384580:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787603998.384698:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:11511:x1874438345796608:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 Request processed in 198us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603998.384706:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 171 00000100:00100000:1.0:1787603998.398140:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603998.398305:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345796736 00000100:00100000:0.0:1787603998.398316:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345796736 00000100:00100000:0.0:1787603998.398377:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 172 00000100:00100000:0.0:1787603998.398388:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:11511:x1874438345796736:12345-192.168.202.21@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787603998.398641:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ffa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398660:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ffa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398672:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ffa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398691:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1902001 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398699:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1902001 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398705:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1902001 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398735:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902008 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398744:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398761:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787603998.398803:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787603998.398807:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787603998.398821:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398833:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ffa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398876:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ffa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398884:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ffa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398891:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603998.398896:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ffa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398903:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ffa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398918:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed290d35200) 00010000:00010000:0.0:1787603998.398922:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603998.398927:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ffa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398934:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1901ffa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398958:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1902001 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398966:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1902001 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398971:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1902001 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398977:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603998.398980:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1902001 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398987:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1902001 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.398995:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9ed28870b200) 00010000:00010000:0.0:1787603998.398998:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603998.399001:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1902001 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.399006:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1902001 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.399021:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.399026:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902008 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.399032:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902008 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.399043:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603998.399046:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902008 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.399052:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902008 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.399061:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed2b2e8b200) 00010000:00010000:0.0:1787603998.399063:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603998.399066:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902008 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.399072:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902008 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603998.399163:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:11511:x1874438345796736:12345-192.168.202.21@tcp:34:lhsmtool_posix.0 Request processed in 774us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603998.399171:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 172 00000100:00100000:0.0:1787603998.406294:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603998.406422:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345796992 00000100:00100000:1.0:1787603998.406432:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345796992 00000100:00100000:1.0:1787603998.406514:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 173 00000100:00100000:1.0:1787603998.406526:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+16:11511:x1874438345796992:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787603998.406557:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603998.406582:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190200f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c96 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.406690:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1902016 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.406705:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1902016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.406717:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1902016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603998.406728:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787603998.406954:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1902016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.406963:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1902016 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.406987:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1902016 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.406994:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fc00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603998.406999:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1902016 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.407007:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1902016 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.407021:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed2b2e8b200) 00010000:00010000:1.0:1787603998.407024:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787603998.407029:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1902016 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.407036:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fc00/0xb5d1f3b1a1902016 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.407076:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190200f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c96 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.407088:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed290d35200) 00010000:00010000:1.0:1787603998.407090:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787603998.407094:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190200f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c96 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.407103:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f400, rc 0) 00000100:00100000:1.0:1787603998.407166:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:11511:x1874438345796992:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 642us (883us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1787603998.407182:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 173 00000100:00100000:1.0:1787603998.415609:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603998.415733:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345797120 00000100:00100000:2.0:1787603998.415744:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345797120 00000100:00100000:2.0:1787603998.415801:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 174 00000100:00100000:2.0:1787603998.415812:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:11511:x1874438345797120:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787603998.415882:0:5821:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787603998.415982:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:11511:x1874438345797120:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 Request processed in 171us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603998.415990:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 174 00000100:00100000:1.0:1787603998.427794:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603998.428028:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345797376 00000100:00100000:2.0:1787603998.428041:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345797376 00000100:00100000:0.0:1787603998.428200:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 175 00000100:00100000:0.0:1787603998.428213:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:11511:x1874438345797376:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787603998.428234:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603998.428237:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787603998.428276:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1901fc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c88 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.428296:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787603998.428313:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787603998.428329:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902024 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5c9d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787603998.430096:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787603998.430644:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190202b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.430664:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190202b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.430676:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190202b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.430743:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a1902024 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c9d expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.430763:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190202b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c9d expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.430772:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed291bd5a00) 00010000:00010000:1.0:1787603998.430776:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787603998.430779:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f400, rc 0) 00000100:00100000:1.0:1787603998.431179:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:11511:x1874438345797376:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 2966us (3393us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787603998.431190:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 175 00000100:00100000:3.0:1787603998.436763:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603998.437037:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345797632 00000100:00100000:2.0:1787603998.437047:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345797632 00000100:00100000:2.0:1787603998.437106:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 176 00000100:00100000:2.0:1787603998.437117:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:11511:x1874438345797632:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787603998.437177:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603998.437207:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190202b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c9d expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.437226:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed291bd5a00) 00010000:00010000:2.0:1787603998.437247:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787603998.437273:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902039 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.437287:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902039 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.437296:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902039 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.437310:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a1902040 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xee276d03 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.437316:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a1902040 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xee276d03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.437336:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a1902040 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xee276d03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.437805:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902039 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.437814:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902039 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.437821:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902039 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.437826:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963c00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603998.437830:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902039 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.437989:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902039 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.438002:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:2.0:1787603998.438004:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603998.438009:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902039 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.438015:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902039 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.438028:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a1902040 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xee276d03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.438033:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a1902040 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xee276d03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.438046:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a1902040 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xee276d03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.438050:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787603998.438053:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a1902040 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xee276d03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.438059:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a1902040 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xee276d03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.438067:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xee276d03 (ffff9ed2b2e8b100) 00010000:00010000:2.0:1787603998.438070:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787603998.438073:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a1902040 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xee276d03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.438078:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a1902040 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xee276d03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603998.438253:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:11511:x1874438345797632:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 1135us (1499us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787603998.438261:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 176 00000100:00100000:3.0:1787603998.450651:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603998.450829:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345797760 00000100:00100000:0.0:1787603998.450863:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345797760 00000100:00100000:0.0:1787603998.450915:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 177 00000100:00100000:0.0:1787603998.450925:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:11511:x1874438345797760:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787603998.450947:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603998.450972:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1902047 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ca4 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.451009:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190204e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.451022:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190204e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.451034:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190204e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.451136:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a1902047 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ca4 expref: 19 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.451153:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190204e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ca4 expref: 18 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.451163:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed28870b200) 00010000:00010000:0.0:1787603998.451166:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787603998.451176:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594000, rc 0) 00000100:00100000:0.0:1787603998.451254:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:11511:x1874438345797760:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 329us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603998.451261:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 177 00000100:00100000:1.0:1787603998.455037:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603998.455671:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345798016 00000100:00100000:0.0:1787603998.455683:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345798016 00000100:00100000:0.0:1787603998.455748:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 178 00000100:00100000:0.0:1787603998.455759:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:11511:x1874438345798016:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787603998.455875:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1902055 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.455893:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1902055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.455905:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1902055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787603998.456234:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1787603998.456245:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331520406774ns, next at 332520404271ns, rc = 0 00000004:00010000:0.0:1787603998.456332:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2c31287 reply state 000000001380d5ba transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1902055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603998.456342:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787603998.456438:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:11511:x1874438345798016:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 681us (1412us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787603998.456446:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 178 00010000:00010000:3.0:1787603998.460724:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1902055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.460745:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1902055 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.460753:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1902055 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.460760:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787603998.460764:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1902055 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.460792:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1902055 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.460812:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed28870b200) 00010000:00010000:3.0:1787603998.460815:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787603998.460820:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1902055 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.460826:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a1902055 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603998.463271:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603998.463374:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345798144 00000100:00100000:0.0:1787603998.463384:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345798144 00000100:00100000:0.0:1787603998.463493:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 179 00000100:00100000:0.0:1787603998.463514:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:11511:x1874438345798144:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787603998.463565:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603998.463587:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190205c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5cab expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.466819:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190205c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cab expref: 20 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.466859:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190205c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cab expref: 20 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.466901:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed28870b200) 00010000:00010000:0.0:1787603998.466905:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787603998.466909:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594e00, rc 0) 00000100:00100000:0.0:1787603998.466986:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:11511:x1874438345798144:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 3483us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603998.466995:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 179 00000100:00100000:3.0:1787603998.491831:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603998.491935:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345798272 00000100:00100000:0.0:1787603998.491945:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345798272 00000100:00100000:0.0:1787603998.492020:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 51 00000100:00100000:0.0:1787603998.492032:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345798272:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787603998.492379:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345798272:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 Request processed in 347us (557us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787603998.492388:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 51 00000100:00080000:3.0:1787603998.492773:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787603998.496271:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603998.496355:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345798528 00000100:00100000:3.0:1787603998.496368:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345798528 00000100:00100000:3.0:1787603998.496427:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 49 00000100:00100000:3.0:1787603998.496438:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:11511:x1874438345798528:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787603998.496829:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:11511:x1874438345798528:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 391us (566us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787603998.496868:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 49 00000100:00100000:1.0:1787603998.499865:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603998.499911:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345798784 00000100:00100000:3.0:1787603998.499923:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345798784 00000100:00100000:3.0:1787603998.500060:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 180 00000100:00100000:3.0:1787603998.500071:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:11511:x1874438345798784:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787603998.500184:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:11511:x1874438345798784:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 115us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603998.500192:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 180 00000100:00100000:3.0:1787603998.512586:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603998.513148:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345798912 00000100:00100000:1.0:1787603998.513160:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345798912 00000100:00100000:1.0:1787603998.525868:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 181 00000100:00100000:1.0:1787603998.525890:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:11511:x1874438345798912:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787603998.525913:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603998.525934:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902063 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5cb2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.526011:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a190206a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.526025:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a190206a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.526036:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a190206a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787603998.526073:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787603998.526091:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a190206a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.526115:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902063 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cb2 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.526133:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a190206a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cb2 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.526142:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed28870b200) 00010000:00010000:1.0:1787603998.526144:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787603998.526156:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7fa00, rc 0) 00000100:00100000:1.0:1787603998.526220:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:11511:x1874438345798912:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 340us (13645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603998.526227:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 181 00000100:00100000:1.0:1787603998.530956:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603998.531034:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345799040 00000100:00100000:0.0:1787603998.531044:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345799040 00000100:00100000:0.0:1787603998.531105:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 52 00000100:00100000:0.0:1787603998.531116:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2364:x1874438345799040:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787603998.531147:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787603998.531168:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902071 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5cb9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787603998.531193:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8cac1e, blocks: 0x1 00010000:00010000:0.0:1787603998.531209:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1787603998.531214:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787603998.531223:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cb9 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.531239:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cb9 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.531252:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594800, rc 0) 00000100:00100000:0.0:1787603998.531312:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2364:x1874438345799040:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 198us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603998.531320:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 52 00000100:00100000:1.0:1787603998.539037:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603998.539121:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345799296 00000100:00100000:3.0:1787603998.539133:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345799296 00000100:00100000:3.0:1787603998.539194:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 182 00000100:00100000:3.0:1787603998.539206:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:11511:x1874438345799296:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787603998.539355:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:11511:x1874438345799296:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 140us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603998.539364:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 182 00000100:00100000:0.0:1787603998.552116:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603998.552212:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345799424 00000100:00100000:1.0:1787603998.552221:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345799424 00000100:00100000:1.0:1787603998.552270:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 53 00000100:00100000:1.0:1787603998.552290:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:11511:x1874438345799424:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787603998.552310:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787603998.552328:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5cc0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.552364:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902071 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cb9 expref: 9 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.552380:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603998.552384:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603998.552389:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc0 expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.552423:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cb9 expref: 9 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.552438:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902071 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cb9 expref: 9 pid: 6679 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603998.552472:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba159500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874438355230720:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603998.552954:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc27180 going to sleep for 11 seconds 00000100:00100000:2.0:1787603998.564267:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603998.564317:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345799552 00000100:00100000:2.0:1787603998.564327:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345799552 00010000:00010000:2.0:1787603998.564385:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902071 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cb9 expref: 10 pid: 6679 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603998.564998:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba159500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874438355230720:192.168.202.21@tcp:104: 00010000:00010000:3.0:1787603998.565056:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc0 expref: 10 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.565081:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f600, rc 0) 00000100:00100000:3.0:1787603998.565159:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:11511:x1874438345799424:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 12872us (13052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603998.565169:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 53 00000100:00100000:2.0:1787603998.565566:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 67 00000100:00100000:2.0:1787603998.565584:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2363:x1874438345799552:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603998.565615:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603998.565642:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902071 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cb9 expref: 9 pid: 6679 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.565658:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cb9 expref: 9 pid: 6679 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.565825:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902071 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cb9 expref: 9 pid: 6679 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.565859:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787603998.565864:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787603998.565872:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc0 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.565882:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc0 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.565922:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc0 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603998.565936:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1874438355230848:192.168.202.21@tcp:105: 00000100:00100000:2.0:1787603998.566011:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295245540 going to sleep for 11 seconds 00000100:00100000:3.0:1787603998.570028:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1874438355230848:192.168.202.21@tcp:105: 00010000:00010000:3.0:1787603998.570058:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603998.570140:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2363:x1874438345799552:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 4562us (5884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603998.570153:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 67 00000100:00100000:3.0:1787603998.576149:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603998.576319:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345799680 00000100:00100000:1.0:1787603998.576329:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345799680 00002000:00100000:1.0:1787603998.576393:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ed2b4d4ed80 x1874438345799680/t0(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:324/0 lens 504/0 e 0 to 0 dl 1787604009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787603998.576404:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2b4d4ed80 with x1874438345799680 ext(0->8) 00002000:00010000:1.0:1787603998.576410:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2b4d4ed80 00000100:00100000:1.0:1787603998.576455:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:1.0:1787603998.576467:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2364:x1874438345799680:12345-192.168.202.21@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787603998.576961:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:2364:x1874438345799680:12345-192.168.202.21@tcp:4:lhsmtool_posix.0 Request processed in 493us (821us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787603998.577612:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4 00002000:00100000:1.0:1787603998.577624:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ed2b4d4ed80 x1874438345799680/t4294967314(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:324/0 lens 504/448 e 0 to 0 dl 1787604009 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787603998.577634:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2b4d4ed80 with x1874438345799680 ext(0->8) 00002000:00010000:1.0:1787603998.577639:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2b4d4ed80 00000100:00100000:0.0:1787603998.594367:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787603998.594470:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345799808 00000100:00100000:2.0:1787603998.594480:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345799808 00000100:00100000:2.0:1787603998.594578:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 183 00000100:00100000:2.0:1787603998.594599:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:11511:x1874438345799808:12345-192.168.202.21@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787603998.629639:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:11511:x1874438345799808:12345-192.168.202.21@tcp:44:lhsmtool_posix.0 Request processed in 35033us (35267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603998.629651:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 183 00000001:00080000:1.0:1787603998.629691:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1787603998.629698:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1787603998.629722:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1787603998.629746:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1787603998.629883:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787603998.629892:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787603998.629905:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355230976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787603998.629957:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603998.635066:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355230976 00000100:00100000:0.0:1787603998.635083:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355230976 00000100:00100000:0.0:1787603998.635159:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787603998.635168:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355230976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787603998.635432:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787603998.635436:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787603998 00002000:00010000:0.0:1787603998.635452:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787603998.635454:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787603998 -> 1787603998 00002000:00010000:0.0:1787603998.635456:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787603998.635542:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355230976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 374us (5584us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787603998.635551:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1787603998.639988:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787603998.640379:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603998.640485:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345799936 00000100:00100000:0.0:1787603998.640494:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345799936 00000100:00100000:0.0:1787603998.640561:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 55 00000100:00100000:0.0:1787603998.640572:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:2363:x1874438345799936:12345-192.168.202.21@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1787603998.640658:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2ba15bb80/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787603998.640669:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355230976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787603998.680352:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355231232:0@lo:400:kworker.0 00000100:00100000:0.0:1787603998.680459:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603998.680533:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787603998.680540:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355231360:0@lo:400:kworker.0 00000100:00100000:0.0:1787603998.680564:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787603998.680607:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355231232 00000100:00100000:0.0:1787603998.680614:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355231232 00000100:00100000:0.0:1787603998.680658:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355231360 00000100:00100000:0.0:1787603998.680661:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355231360 00000100:00100000:0.0:1787603998.680696:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787603998.680706:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355231232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603998.680767:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355231232:12345-0@lo:400:kworker.0 Request processed in 61us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603998.680773:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787603998.680791:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787603998.680796:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355231360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603998.680822:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355231360:12345-0@lo:400:kworker.0 Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603998.680865:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787603998.680908:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355231360:0@lo:400:kworker.0 00000100:00100000:0.0:1787603998.680919:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355231232:0@lo:400:kworker.0 00000100:00100000:1.0:1787603998.681069:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355231104:0@lo:400:kworker.0 00000100:00100000:1.0:1787603998.681106:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603998.681142:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787603998.681149:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af7bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355231488:0@lo:400:kworker.0 00000100:00100000:1.0:1787603998.681171:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603998.682342:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787603998.682356:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355231616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787603998.682402:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603998.682444:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355231616 00000100:00100000:1.0:1787603998.682450:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355231616 00000100:00100000:1.0:1787603998.682511:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787603998.682521:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355231616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787603998.682556:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787603998.682607:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355231616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603998.682614:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787603998.682652:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355231616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787603998.684579:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355231488 00000100:00100000:1.0:1787603998.684593:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355231488 00000100:00100000:1.0:1787603998.684679:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787603998.684689:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355231488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787603998.684793:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355231488:12345-0@lo:400:kworker.0 Request processed in 105us (3620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603998.684800:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787603998.684866:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af7bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355231488:0@lo:400:kworker.0 00000100:00100000:0.0:1787603998.685554:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355231104 00000100:00100000:0.0:1787603998.685561:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355231104 00000100:00100000:0.0:1787603998.685611:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787603998.685621:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355231104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787603998.685673:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3282:x1874438355231104:12345-0@lo:400:kworker.0 Request processed in 55us (4567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603998.685679:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787603998.685724:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355231104:0@lo:400:kworker.0 00000100:00080000:2.0:1787603998.687185:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787603998.716811:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1787603998.716834:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1787603998.716859:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1787603998.717401:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345799936:12345-192.168.202.21@tcp:16:lhsmtool_posix.0 Request processed in 76826us (77022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603998.717410:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 55 00000100:00100000:3.0:1787603998.720384:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603998.720613:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345800192 00000100:00100000:0.0:1787603998.720625:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345800192 00000100:00100000:0.0:1787603998.720688:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 184 00000100:00100000:0.0:1787603998.720697:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:11511:x1874438345800192:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787603998.720751:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603998.720781:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a190206a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cb2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.720799:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed28870b200) 00010000:00010000:0.0:1787603998.720804:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787603998.720881:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190207f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.720896:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190207f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.720906:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190207f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787603998.721210:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086dc627d reply state 000000001ff0677b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190207f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603998.721220:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787603998.721323:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:11511:x1874438345800192:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 625us (948us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787603998.721331:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 184 00000100:00100000:1.0:1787603998.728901:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603998.728939:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345800320 00000100:00100000:1.0:1787603998.728948:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345800320 00000100:00100000:1.0:1787603998.728994:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 56 00000100:00100000:1.0:1787603998.729001:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345800320:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787603998.729203:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787603998.729205:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787603998 -> 1787603997 00002000:00010000:1.0:1787603998.729207:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787603995 00002000:00010000:1.0:1787603998.729209:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787603998 -> 1787603997 00002000:00010000:1.0:1787603998.729211:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787603998.729269:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2363:x1874438345800320:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 Request processed in 267us (381us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787603998.729274:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 56 00010000:00010000:0.0:1787603998.733910:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190207f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.733931:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190207f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.733940:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190207f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.733946:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603998.733951:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190207f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.733963:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190207f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.733989:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed28870b200) 00010000:00010000:0.0:1787603998.733999:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603998.734005:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190207f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.734013:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190207f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603998.739957:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603998.740257:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345800576 00000100:00100000:1.0:1787603998.740266:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345800576 00000100:00100000:1.0:1787603998.740312:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 185 00000100:00100000:1.0:1787603998.740320:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:11511:x1874438345800576:12345-192.168.202.21@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787603998.740568:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.740584:0:7875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190204e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ca4 expref: 18 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.740591:0:7875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.740621:0:7875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190204e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ca4 expref: 18 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.740631:0:7875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190204e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ca4 expref: 18 pid: 7875 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603998.740642:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba159500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355231744:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787603998.740722:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2000 going to sleep for 11 seconds 00000100:00100000:1.0:1787603998.742791:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba159500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355231744:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603998.742814:0:7875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603998.745131:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603998.745236:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345800704 00000100:00100000:0.0:1787603998.745246:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345800704 00010000:00010000:0.0:1787603998.745283:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190204e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ca4 expref: 19 pid: 7875 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603998.745327:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 68 00000100:00100000:0.0:1787603998.745337:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2aa48d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:2364:x1874438345800704:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787603998.745351:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787603998.745358:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190204e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ca4 expref: 19 pid: 7875 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.745372:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190204e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ca4 expref: 19 pid: 7875 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.745394:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a190204e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ca4 expref: 19 pid: 7875 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.745408:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed28870b200) 00010000:00010000:0.0:1787603998.745414:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.745423:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.745436:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.745462:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787603998.745531:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2aa48d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:2364:x1874438345800704:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 195us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603998.745548:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 68 00010000:00010000:0.0:1787603998.745609:0:7875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.745618:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.746587:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.746597:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.746602:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.746615:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fe00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603998.746619:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.746624:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.746633:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed28870b200) 00010000:00010000:1.0:1787603998.746635:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787603998.746638:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.746642:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a1902086 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603998.746699:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:11511:x1874438345800576:12345-192.168.202.21@tcp:55:lhsmtool_posix.0 Request processed in 6377us (6752us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787603998.746708:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 185 00000100:00100000:3.0:1787603998.765870:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603998.765920:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345800832 00000100:00100000:1.0:1787603998.765933:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345800832 00000100:00100000:1.0:1787603998.766002:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 57 00000100:00100000:1.0:1787603998.766015:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2363:x1874438345800832:12345-192.168.202.21@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787603998.766098:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.766120:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc0 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.766146:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787603998.766151:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787603998.766155:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.766193:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc0 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.766207:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc0 expref: 8 pid: 6678 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603998.766224:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba159500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874438355231872:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787603998.766316:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2000 going to sleep for 11 seconds 00000040:00080000:0.0:1787603998.766675:0:12389:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787603998.766680:0:12389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787603998.766719:0:12389:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787603998.766727:0:12389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787603998.774722:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603998.775255:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba159500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874438355231872:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603998.775279:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603998.775675:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345800960 00000100:00100000:2.0:1787603998.775683:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345800960 00010000:00010000:2.0:1787603998.775723:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc0 expref: 9 pid: 6678 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787603998.775770:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 69 00000100:00100000:2.0:1787603998.775781:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2363:x1874438345800960:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787603998.775797:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787603998.775819:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc0 expref: 9 pid: 6678 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.775832:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc0 expref: 9 pid: 6678 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.775880:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e86809a6/0xb5d1f3b1a1902078 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc0 expref: 9 pid: 6678 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.775895:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787603998.775899:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787603998.775905:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.775915:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787603998.775952:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787603998.776008:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2363:x1874438345800960:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 228us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787603998.776017:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 69 00010000:00010000:0.0:1787603998.776448:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.776461:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.776512:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.776522:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.776531:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.776538:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f000 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787603998.776542:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.776552:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.776564:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.776572:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ff6b885/0xb5d1f3b1a190208d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603998.776620:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345800832:12345-192.168.202.21@tcp:1:lhsmtool_posix.0 Request processed in 10608us (10793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787603998.776629:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 57 00000100:00100000:3.0:1787603998.781935:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787603998.782470:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345801216 00000100:00100000:0.0:1787603998.782483:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345801216 00000100:00100000:0.0:1787603998.782560:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 186 00000100:00100000:0.0:1787603998.782571:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+17:11511:x1874438345801216:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787603998.782644:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1902094 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.782661:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1902094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.782672:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1902094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.782884:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.782894:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190205c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cab expref: 18 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.782902:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.782936:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190205c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cab expref: 18 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.782949:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190205c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cab expref: 18 pid: 7875 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603998.782962:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b498ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355232000:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787603998.783039:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2868ab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603998.795315:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603998.795364:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345801344 00000100:00100000:3.0:1787603998.795380:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345801344 00010000:00010000:3.0:1787603998.795419:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190205c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cab expref: 19 pid: 7875 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603998.795459:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 70 00000100:00100000:3.0:1787603998.795471:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:2364:x1874438345801344:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787603998.795485:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603998.795493:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190205c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cab expref: 19 pid: 7875 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.795522:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190205c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cab expref: 19 pid: 7875 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.795546:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed28870b200) 00010000:00010000:3.0:1787603998.795552:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.795560:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.795567:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.795586:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787603998.795649:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:2364:x1874438345801344:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 180us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603998.795664:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 70 00010000:00010000:1.0:1787603998.796431:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190205c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cab expref: 18 pid: 7875 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603998.796448:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b498ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355232000:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787603998.796470:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.796479:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.796486:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787603998.796692:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787603998.796833:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787603998.797350:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1787603998.797430:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5823:1874438355232128:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787603998.797484:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787603998.797557:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295245540 going to sleep for 11 seconds 00000100:00100000:3.0:1787603998.797703:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355232128 00000100:00100000:3.0:1787603998.797711:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355232128 00000100:00100000:3.0:1787603998.797774:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787603998.797785:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1874438355232128:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787603998.797893:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1874438355232128:12345-0@lo:1000:mdt00_002.0 Request processed in 108us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603998.797901:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787603998.797908:0:5823:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787603998.797915:0:5823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2ba15bb80, transno 4294967315 00000100:00100000:1.0:1787603998.797927:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5823:1874438355232128:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787603998.798298:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787603998.798346:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba159500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5823:1874438355232256:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787603998.798389:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603998.798411:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787603998.798778:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355232256 00000100:00100000:2.0:1787603998.798785:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355232256 00000100:00100000:2.0:1787603998.798812:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787603998.798820:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1874438355232256:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787603998.799008:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1874438355232256:12345-0@lo:1000:mdt00_002.0 Request processed in 187us (617us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787603998.799016:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787603998.799286:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba159500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5823:1874438355232256:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787603998.799316:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799326:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799333:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799339:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603998.799345:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799352:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799367:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed28870b200) 00010000:00010000:1.0:1787603998.799369:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787603998.799382:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799387:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190209b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799414:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901fd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799420:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901fd0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799425:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901fd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799429:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787603998.799432:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901fd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799437:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901fd0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799444:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed2b2e8b200) 00010000:00010000:1.0:1787603998.799446:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787603998.799448:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901fd0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799454:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a1901fd0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799472:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799484:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c8f expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799496:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799534:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c8f expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787603998.799548:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c8f expref: 21 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787603998.800068:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba15bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355232384:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787603998.800143:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787603998.805389:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787603998.805427:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345801472 00000100:00100000:3.0:1787603998.805437:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345801472 00010000:00010000:3.0:1787603998.805472:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c8f expref: 22 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603998.805523:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 71 00000100:00100000:3.0:1787603998.805534:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:2363:x1874438345801472:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787603998.805548:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787603998.805555:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c8f expref: 22 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.805569:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c8f expref: 22 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.805590:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed2b2e8b200) 00010000:00010000:3.0:1787603998.805596:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.805617:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.805625:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.805647:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787603998.805681:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a1901fec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5c8f expref: 22 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787603998.805705:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba15bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355232384:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787603998.805726:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805736:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805751:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805766:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805777:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805784:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805790:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fe00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603998.805795:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805805:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805815:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed2b2e8b200) 00010000:00010000:0.0:1787603998.805818:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787603998.805829:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805849:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19020a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805861:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1902094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805866:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1902094 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805872:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1902094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805877:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787603998.805880:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1902094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805886:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1902094 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805899:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed2b2e8b200) 00010000:00010000:0.0:1787603998.805902:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787603998.805905:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1902094 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.805911:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594000/0xb5d1f3b1a1902094 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787603998.806181:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:2363:x1874438345801472:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 648us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787603998.806190:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 71 00000100:00100000:0.0:1787603998.806288:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:11511:x1874438345801216:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 23717us (24362us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787603998.806298:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 186 00000020:00080000:0.0:1787603998.806309:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787603998.806412:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787603998.806417:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787603998.807286:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787603998.807298:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787603998.813566:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787603998.815611:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345801728 00000100:00100000:1.0:1787603998.815624:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345801728 00000100:00100000:1.0:1787603998.815685:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 50 00000100:00100000:1.0:1787603998.815698:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed291f92450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:11511:x1874438345801728:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787603998.816411:0:11963:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787603998.816538:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787603998.816586:0:11963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19020a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.816603:0:11963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19020a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.816615:0:11963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19020a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.816623:0:11963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19020a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.816630:0:11963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19020a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.816636:0:11963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19020a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787603998.816661:0:11963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787603998.816777:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed291f92450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:11511:x1874438345801728:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 1079us (3218us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787603998.816787:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 50 00000020:00080000:3.0:1787603998.816793:0:11963:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787603998.819887:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787603998.819901:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19020a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.819913:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787603998.819918:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19020a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.819929:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19020a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.819948:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ed290d35d00) 00010000:00010000:0.0:1787603998.819951:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787603998.819956:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19020a9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.819962:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19020a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787603998.819980:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603998.819982:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787603998.819984:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787603999.127604:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787603999.191477:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355232512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787603999.191567:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787603999.191872:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355232512 00000100:00100000:1.0:1787603999.191881:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355232512 00000100:00100000:1.0:1787603999.191953:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787603999.191963:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b498aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874438355232512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787603999.191987:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1787603999.192046:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b498aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874438355232512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787603999.192053:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787603999.192141:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355232512:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787604000.151050:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787604000.967112:0:12441:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787604000.967122:0:12441:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787604000.967162:0:12441:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787604000.967171:0:12441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787604001.114281:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604001.114350:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345801984 00000100:00100000:0.0:1787604001.114361:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345801984 00000100:00100000:0.0:1787604001.114436:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 187 00000100:00100000:0.0:1787604001.114446:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:11529:x1874438345801984:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787604001.114468:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604001.114499:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19020b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5cc7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.114742:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19020b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.114758:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19020b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.114771:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19020b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787604001.114783:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787604001.114981:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19020b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc7 expref: 25 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.114998:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19020b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc7 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.115007:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787604001.115010:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787604001.115019:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595c00, rc 0) 00000100:00100000:0.0:1787604001.115072:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:11529:x1874438345801984:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 626us (800us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1787604001.115079:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 187 00000100:00080000:1.0:1787604001.115253:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787604001.121408:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604001.121464:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345802112 00000100:00100000:3.0:1787604001.121474:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345802112 00000100:00100000:3.0:1787604001.121547:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 188 00000100:00100000:3.0:1787604001.121559:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:11529:x1874438345802112:12345-192.168.202.21@tcp:34:lfs.0 00010000:00010000:3.0:1787604001.121644:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19020c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.121661:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19020c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.121672:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19020c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.121686:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19020cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.121693:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19020cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.121699:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19020cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122072:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19020d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122082:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19020d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122227:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19020d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787604001.122270:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19020d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122282:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19020c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122288:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19020c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122295:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19020c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122300:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604001.122304:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19020c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122311:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19020c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122321:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:3.0:1787604001.122324:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604001.122328:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19020c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122334:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19020c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122344:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19020cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122527:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19020cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122534:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19020cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122539:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604001.122542:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19020cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122548:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19020cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122557:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed290d35900) 00010000:00010000:3.0:1787604001.122560:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604001.122563:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19020cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122569:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19020cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122583:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19020d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122589:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19020d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122594:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19020d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122598:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604001.122607:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19020d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122613:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19020d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122620:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed290d35d00) 00010000:00010000:3.0:1787604001.122622:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604001.122624:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19020d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.122630:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19020d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604001.122721:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:11529:x1874438345802112:12345-192.168.202.21@tcp:34:lfs.0 Request processed in 1162us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604001.122730:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 188 00010000:00010000:0.0:1787604001.179501:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604001.195136:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604001.195291:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345802368 00000100:00100000:1.0:1787604001.195302:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345802368 00000100:00100000:1.0:1787604001.195370:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 189 00000100:00100000:1.0:1787604001.195384:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b498a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:11532:x1874438345802368:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787604001.195411:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604001.195433:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19020da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5cce expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.195514:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a19020e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.195529:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a19020e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.195540:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a19020e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.195554:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19020e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.195561:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19020e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.195567:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19020e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.195939:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19020ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.195949:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19020ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.195968:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19020ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604001.195980:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787604001.196078:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a19020e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196086:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a19020e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196093:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a19020e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196099:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fa00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604001.196104:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a19020e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196111:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a19020e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196124:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:1.0:1787604001.196127:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604001.196132:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a19020e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196137:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a19020e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196149:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19020e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196154:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19020e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196164:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19020e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196169:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7ec00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604001.196172:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19020e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196178:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19020e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196185:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed291bd5100) 00010000:00010000:1.0:1787604001.196187:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604001.196190:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19020e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196195:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19020e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196237:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19020da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cce expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196251:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19020ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cce expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.196258:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5d00) 00010000:00010000:1.0:1787604001.196260:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787604001.196263:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f400, rc 0) 00000100:00100000:1.0:1787604001.196335:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b498a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:11532:x1874438345802368:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 953us (1210us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787604001.196352:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 189 00000100:00100000:1.0:1787604001.199958:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604001.200411:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345802496 00000100:00100000:0.0:1787604001.200423:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345802496 00000100:00100000:0.0:1787604001.200492:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 190 00000100:00100000:0.0:1787604001.200504:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:11532:x1874438345802496:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:0.0:1787604001.200571:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19020fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.200586:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19020fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.200598:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19020fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.200625:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19020fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.200633:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19020fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.200640:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19020fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.200645:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604001.200650:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19020fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.200674:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19020fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.200687:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5d00) 00010000:00010000:0.0:1787604001.200690:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787604001.200695:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19020fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.200701:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594200/0xb5d1f3b1a19020fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604001.200781:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:11532:x1874438345802496:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 279us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604001.200790:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 190 00000100:00100000:3.0:1787604001.210523:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604001.216162:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345802752 00000100:00100000:1.0:1787604001.216179:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345802752 00000100:00100000:1.0:1787604001.217446:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 51 00000100:00100000:1.0:1787604001.217464:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:11532:x1874438345802752:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:1.0:1787604001.217732:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+27:11532:x1874438345802752:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 273us (7223us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787604001.217739:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 51 00000100:00100000:3.0:1787604001.287272:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604001.287376:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345803008 00000100:00100000:2.0:1787604001.287387:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345803008 00000100:00100000:2.0:1787604001.287468:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 191 00000100:00100000:2.0:1787604001.287491:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+27:11058:x1874438345803008:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:2.0:1787604001.287516:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604001.287537:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1902104 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5cd5 expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.287678:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.287696:0:7875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19020ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cce expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.287704:0:7875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.287741:0:7875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19020ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cce expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.287757:0:7875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19020ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cce expref: 28 pid: 5821 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604001.287772:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf472680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355232640:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787604001.287901:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed287cb1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787604001.299929:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf472680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355232640:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604001.299966:0:7875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604001.312224:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604001.312297:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345803136 00000100:00100000:1.0:1787604001.312308:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345803136 00010000:00010000:1.0:1787604001.312367:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19020ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cce expref: 29 pid: 5821 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604001.312615:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 72 00000100:00100000:1.0:1787604001.312626:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:2364:x1874438345803136:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604001.312642:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604001.312649:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19020ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cce expref: 29 pid: 5821 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.312663:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19020ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cce expref: 29 pid: 5821 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.312685:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19020ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cce expref: 29 pid: 5821 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.312718:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5d00) 00010000:00010000:1.0:1787604001.312724:0:6693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.312734:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.312741:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.312767:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604001.312821:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+28:2364:x1874438345803136:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 196us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604001.312829:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 72 00010000:00010000:1.0:1787604001.312960:0:7875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.312968:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604001.312985:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787604001.313127:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1902104 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cd5 expref: 29 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.313150:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cd5 expref: 28 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.313159:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5d00) 00010000:00010000:1.0:1787604001.313167:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787604001.313170:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963400, rc 0) 00000100:00100000:1.0:1787604001.313199:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+28:11058:x1874438345803008:12345-192.168.202.21@tcp:101:bash.0 Request processed in 25721us (25938us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787604001.313206:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 191 00000100:00100000:3.0:1787604001.316074:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604001.316161:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345803392 00000100:00100000:1.0:1787604001.316171:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345803392 00000100:00100000:1.0:1787604001.316230:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 192 00000100:00100000:1.0:1787604001.316241:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+28:11058:x1874438345803392:12345-192.168.202.21@tcp:36:bash.0 00010000:00010000:1.0:1787604001.316671:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902119 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.316689:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902119 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.316701:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902119 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787604001.316755:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1787604001.316781:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000510d8143 reply state 000000000bc3053d transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902119 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604001.316791:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787604001.316872:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1787604001.316980:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:11058:x1874438345803392:12345-192.168.202.21@tcp:36:bash.0 Request processed in 740us (913us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1787604001.316988:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 192 00000020:00080000:1.0:1787604001.316993:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787604001.318809:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902119 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.318823:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902119 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.318830:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902119 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.318890:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fa00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604001.318895:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902119 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.318916:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902119 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.318933:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5d00) 00010000:00010000:3.0:1787604001.318936:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604001.318940:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902119 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.318946:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902119 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604001.319267:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604001.319306:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345803520 00000100:00100000:3.0:1787604001.319314:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345803520 00000100:00100000:3.0:1787604001.319632:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 193 00000100:00100000:3.0:1787604001.319643:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:11058:x1874438345803520:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:3.0:1787604001.319663:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604001.319680:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1902120 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5cdc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.319734:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1902120 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cdc expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.319747:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1902120 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cdc expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.319766:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5d00) 00010000:00010000:3.0:1787604001.319769:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787604001.319772:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac000, rc 0) 00000100:00100000:3.0:1787604001.319829:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:11058:x1874438345803520:12345-192.168.202.21@tcp:101:bash.0 Request processed in 188us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604001.319863:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 193 00000100:00100000:1.0:1787604001.324949:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604001.326569:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345803648 00000100:00100000:2.0:1787604001.326583:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345803648 00000100:00100000:2.0:1787604001.326659:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 58 00000100:00100000:2.0:1787604001.326671:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:11058:x1874438345803648:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:2.0:1787604001.326703:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604001.326725:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e08efd82/0xb5d1f3b1a1902127 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ce3 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787604001.326752:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8cac1d, atime: 0x6a8cac1b, ctime: 0x6a8cac1d, blocks: 0xb 00010000:00010000:2.0:1787604001.326773:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=334s v=(0 0) 00010000:00010000:2.0:1787604001.326777:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604001.326786:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e08efd82/0xb5d1f3b1a1902127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ce3 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.326802:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e08efd82/0xb5d1f3b1a1902127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ce3 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.326816:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963a00, rc 0) 00000100:00100000:2.0:1787604001.326904:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:11058:x1874438345803648:12345-192.168.202.21@tcp:101:bash.0 Request processed in 236us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604001.326912:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 58 00000100:00080000:1.0:1787604001.326970:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787604001.331008:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604001.331127:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345803776 00000100:00100000:2.0:1787604001.331137:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345803776 00002000:00010000:2.0:1787604001.331176:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787604001.331181:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2b9df5880 with x1874438345803776 ext(0->18446744073709551615) 00002000:00010000:2.0:1787604001.331193:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2b9df5880. 00000100:00100000:2.0:1787604001.331265:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:2.0:1787604001.331276:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2363:x1874438345803776:12345-192.168.202.21@tcp:10:bash.0 00002000:00010000:2.0:1787604001.331566:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787604001.331583:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787603997 -> 1787604001 00002000:00010000:2.0:1787604001.331586:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787603995 -> 1787603995 00002000:00010000:2.0:1787604001.331589:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787603997 -> 1787604001 00002000:00010000:2.0:1787604001.331592:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787604001.331698:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2363:x1874438345803776:12345-192.168.202.21@tcp:10:bash.0 Request processed in 423us (697us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787604001.331706:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5 00002000:00010000:2.0:1787604001.331710:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787604001.331713:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2b9df5880 with x1874438345803776 ext(0->18446744073709551615) 00002000:00010000:2.0:1787604001.331718:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2b9df5880. 00000100:00100000:0.0:1787604001.438932:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604001.439067:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345803904 00000100:00100000:1.0:1787604001.439077:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345803904 00000100:00100000:1.0:1787604001.439141:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 194 00000100:00100000:1.0:1787604001.439153:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:11546:x1874438345803904:12345-192.168.202.21@tcp:34:lfs.0 00010000:00010000:1.0:1787604001.439220:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190212e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439238:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190212e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439250:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190212e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439265:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439272:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439279:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439579:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190213c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439589:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190213c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439596:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190213c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787604001.439638:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190213c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439660:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190212e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439667:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190212e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439673:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190212e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439679:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604001.439683:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190212e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439690:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190212e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439703:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:1.0:1787604001.439706:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604001.439710:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190212e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439716:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a190212e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439728:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439734:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902135 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439739:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439751:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604001.439754:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439761:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902135 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439770:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed291bd5100) 00010000:00010000:1.0:1787604001.439772:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604001.439775:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902135 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439780:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439794:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190213c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439801:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190213c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439806:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190213c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439811:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604001.439814:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190213c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439821:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190213c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439898:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5d00) 00010000:00010000:1.0:1787604001.439901:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604001.439904:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190213c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.439910:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190213c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604001.439990:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:11546:x1874438345803904:12345-192.168.202.21@tcp:34:lfs.0 Request processed in 838us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604001.439997:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 194 00000100:00100000:2.0:1787604001.508182:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604001.508288:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345804160 00000100:00100000:3.0:1787604001.508298:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345804160 00000100:00100000:3.0:1787604001.508371:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 195 00000100:00100000:3.0:1787604001.508382:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+32:11549:x1874438345804160:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787604001.508404:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604001.508426:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902143 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5cea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.508531:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190214a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.508544:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190214a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.508553:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190214a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.508567:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902151 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.508573:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.508581:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.508957:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1902158 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.508975:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1902158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.508982:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1902158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604001.508994:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787604001.509090:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190214a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509098:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190214a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509105:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190214a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509111:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604001.509115:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190214a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509123:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190214a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509136:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:3.0:1787604001.509139:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604001.509143:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190214a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509149:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190214a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509161:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509173:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902151 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509179:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509184:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604001.509187:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509193:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509201:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed290d35d00) 00010000:00010000:3.0:1787604001.509203:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604001.509206:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902151 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509211:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902151 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509252:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902143 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cea expref: 35 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509263:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1902158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cea expref: 34 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.509270:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5d00) 00010000:00010000:3.0:1787604001.509273:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787604001.509281:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad200, rc 0) 00000100:00100000:3.0:1787604001.509353:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+34:11549:x1874438345804160:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 972us (1180us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787604001.509361:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 195 00000100:00100000:2.0:1787604001.512554:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604001.512658:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345804288 00000100:00100000:1.0:1787604001.512667:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345804288 00000100:00100000:1.0:1787604001.512722:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 196 00000100:00100000:1.0:1787604001.512732:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+34:11549:x1874438345804288:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:1.0:1787604001.512795:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.512810:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cd5 expref: 34 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.512821:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.512924:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cd5 expref: 34 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.512938:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cd5 expref: 34 pid: 7875 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604001.512959:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bed4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355232768:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787604001.513041:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b9ef2780 going to sleep for 11 seconds 00000100:00100000:0.0:1787604001.523278:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604001.523785:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bed4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355232768:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787604001.523812:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604001.524090:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345804544 00000100:00100000:3.0:1787604001.524098:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345804544 00000100:00100000:3.0:1787604001.524204:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 52 00000100:00100000:3.0:1787604001.524224:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+35:5605:x1874438345804544:12345-192.168.202.21@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787604001.524793:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+36:5605:x1874438345804544:12345-192.168.202.21@tcp:35:ldlm_bl.0 Request processed in 568us (1521us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787604001.524802:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 52 00000100:00100000:2.0:1787604001.530806:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604001.531035:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345804672 00000100:00100000:3.0:1787604001.531046:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345804672 00010000:00010000:3.0:1787604001.531153:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cd5 expref: 36 pid: 7875 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604001.531295:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 73 00000100:00100000:3.0:1787604001.531306:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+36:2363:x1874438345804672:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787604001.531441:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604001.531451:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cd5 expref: 36 pid: 7875 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.531466:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cd5 expref: 36 pid: 7875 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.531498:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190210b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cd5 expref: 36 pid: 7875 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.531532:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5d00) 00010000:00010000:3.0:1787604001.531537:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.531547:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.531555:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.531589:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787604001.531641:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+35:2363:x1874438345804672:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 336us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604001.531648:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 73 00010000:00010000:1.0:1787604001.532689:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.532703:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.532739:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.532746:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.532753:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.532760:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604001.532764:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.532771:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.532783:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5d00) 00010000:00010000:1.0:1787604001.532798:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787604001.532803:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.532809:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604001.532942:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+34:11549:x1874438345804288:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 20209us (20394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604001.532952:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 196 00000100:00100000:2.0:1787604001.535582:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604001.535675:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345804928 00000100:00100000:1.0:1787604001.535685:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345804928 00000100:00100000:1.0:1787604001.535772:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 53 00000100:00100000:1.0:1787604001.535783:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+34:11549:x1874438345804928:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:1.0:1787604001.536534:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+35:11549:x1874438345804928:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 749us (958us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787604001.536542:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 53 00000100:00100000:1.0:1787604001.581257:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604001.581299:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604001.581452:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604001.581604:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345805056 00000100:00100000:3.0:1787604001.581614:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345805056 00000100:00100000:3.0:1787604001.581671:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 297 00000100:00100000:3.0:1787604001.581681:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2366:x1874438345805056:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787604001.581752:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2366:x1874438345805056:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 73us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604001.581760:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 297 00000100:00100000:0.0:1787604001.581890:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345805184 00000100:00100000:0.0:1787604001.581896:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345805184 00000100:00100000:0.0:1787604001.581935:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 72 00000100:00100000:0.0:1787604001.581942:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345805184:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787604001.581970:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345805184:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604001.581977:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 72 00000100:00080000:3.0:1787604001.582091:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787604001.584909:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345805312 00000100:00100000:2.0:1787604001.584926:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345805312 00000100:00100000:2.0:1787604001.585024:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 156 00000100:00100000:2.0:1787604001.585036:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2366:x1874438345805312:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787604001.585113:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2366:x1874438345805312:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (3813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604001.585121:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 156 00000100:00080000:3.0:1787604001.585969:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787604001.692690:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604001.692825:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345805568 00000100:00100000:3.0:1787604001.692987:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345805568 00000100:00100000:3.0:1787604001.693052:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 197 00000100:00100000:3.0:1787604001.693064:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b498b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+35:11560:x1874438345805568:12345-192.168.202.21@tcp:101:cat.0 00010000:00010000:3.0:1787604001.693114:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604001.693135:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190216d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5cf1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.693493:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902174 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.693511:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902174 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.693522:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902174 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.693538:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190217b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.693545:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190217b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.693552:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190217b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694154:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1902182 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694303:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1902182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694311:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1902182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604001.694391:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787604001.694513:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902174 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694523:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902174 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694530:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902174 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694536:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604001.694540:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902174 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694548:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902174 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694560:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:3.0:1787604001.694564:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604001.694568:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902174 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694574:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902174 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694587:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190217b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694593:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190217b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694599:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190217b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694603:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604001.694613:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190217b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694619:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190217b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694627:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed290d35d00) 00010000:00010000:3.0:1787604001.694630:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604001.694633:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190217b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694639:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190217b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694684:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190216d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cf1 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694698:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1902182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cf1 expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.694705:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5d00) 00010000:00010000:3.0:1787604001.694708:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787604001.694710:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dadc00, rc 0) 00000100:00100000:3.0:1787604001.694791:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b498b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:11560:x1874438345805568:12345-192.168.202.21@tcp:101:cat.0 Request processed in 1728us (2109us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787604001.694799:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 197 00000100:00100000:2.0:1787604001.702960:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604001.703623:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345805824 00000100:00100000:3.0:1787604001.703636:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345805824 00000100:00100000:3.0:1787604001.703704:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 54 00000100:00100000:3.0:1787604001.703715:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:11560:x1874438345805824:12345-192.168.202.21@tcp:35:cat.0 00000100:00100000:3.0:1787604001.704485:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+38:11560:x1874438345805824:12345-192.168.202.21@tcp:35:cat.0 Request processed in 761us (1528us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787604001.704496:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 54 00000100:00100000:1.0:1787604001.733606:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604001.734947:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345806080 00000100:00100000:2.0:1787604001.734964:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345806080 00000100:00100000:2.0:1787604001.735043:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 198 00000100:00100000:2.0:1787604001.735055:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+38:11561:x1874438345806080:12345-192.168.202.21@tcp:36:rm.0 00010000:00010000:2.0:1787604001.735143:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787604001.735174:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dadc00/0xb5d1f3b1a1902182 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cf1 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.735198:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a1902158 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cea expref: 37 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.735210:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a1902120 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cdc expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.735220:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed291bd5d00) 00010000:00010000:2.0:1787604001.735232:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787604001.735255:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1902190 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.735268:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1902190 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.735277:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1902190 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.735292:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1902197 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.735299:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1902197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.735305:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1902197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.735651:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a190219e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.735660:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a190219e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.735666:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a190219e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787604001.736347:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1787604001.736359:0:5821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334800521191ns, next at 335800518704ns, rc = 0 00010000:00010000:2.0:1787604001.736422:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19021a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736434:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19021a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736441:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19021a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736448:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19021a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736454:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19021a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736459:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19021a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736497:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604001.736517:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a190219e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736529:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a190219e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736534:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a190219e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736539:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787604001.736543:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a190219e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736551:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a190219e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736561:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed2b2e8bb00) 00010000:00010000:2.0:1787604001.736564:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787604001.736569:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a190219e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736575:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a190219e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736594:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1902190 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736600:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1902190 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.736602:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604001.736606:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1902190 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.736609:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19021a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736611:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604001.736615:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963600 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604001.736618:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1902190 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.736619:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19021a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.736626:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19021a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736626:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1902190 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.736635:0:6692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ed2b2e8bb00) 00010000:00010000:2.0:1787604001.736635:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:3.0:1787604001.736637:0:6692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787604001.736637:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604001.736641:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19021a5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736641:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1902190 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.736648:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19021a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.736648:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a1902190 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787604001.736657:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d997f144 reply state 000000008f6584c1 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1902197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.736662:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604001.736663:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604001.736665:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604001.736666:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787604001.736764:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+37:11561:x1874438345806080:12345-192.168.202.21@tcp:36:rm.0 Request processed in 1708us (3165us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787604001.736773:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 198 00010000:00010000:1.0:1787604001.739291:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1902197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.739309:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1902197 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.739315:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1902197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.739342:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604001.739347:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1902197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.739360:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1902197 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.739377:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed2b2e8b300) 00010000:00010000:1.0:1787604001.739380:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604001.739384:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1902197 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.739399:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a1902197 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604001.816277:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000001:00080000:2.0:1787604001.816674:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:1.0:1787604001.816909:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345806336 00000100:00100000:1.0:1787604001.816919:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345806336 00000100:00100000:1.0:1787604001.817042:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 199 00000100:00100000:1.0:1787604001.817053:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+36:11567:x1874438345806336:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:1.0:1787604001.817078:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604001.817234:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19021ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5cf8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.817358:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19021b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.817374:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19021b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.817452:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19021b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.817464:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19021ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.817469:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19021ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604001.817481:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19021ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787604001.818077:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787604001.818256:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a19021c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.818268:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a19021c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.818275:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a19021c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.818332:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19021b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.818338:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19021b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.818344:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19021b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.818351:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fe00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787604001.818356:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19021b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.818363:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19021b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.818375:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:2.0:1787604001.818379:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604001.818384:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19021b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.818390:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fe00/0xb5d1f3b1a19021b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787604001.818402:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000234a344 reply state 00000000fd80dc0c transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19021ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604001.818411:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787604001.818442:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f400/0xb5d1f3b1a19021ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cf8 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.818468:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a19021c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cf8 expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.818490:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed2b2e8ba00) 00010000:00010000:2.0:1787604001.818492:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787604001.818494:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962800, rc 0) 00000100:00100000:2.0:1787604001.818570:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+39:11567:x1874438345806336:12345-192.168.202.21@tcp:101:bash.0 Request processed in 1519us (2300us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787604001.818578:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 199 00010000:00010000:3.0:1787604001.820387:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19021ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.820402:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19021ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.820422:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19021ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.820427:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604001.820432:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19021ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.820439:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19021ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.820454:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed291bd5800) 00010000:00010000:3.0:1787604001.820456:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604001.820460:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19021ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604001.820465:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19021ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604001.823771:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604001.824350:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345806464 00000100:00100000:0.0:1787604001.824361:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345806464 00000100:00100000:0.0:1787604001.824487:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 59 00000100:00100000:0.0:1787604001.824498:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345806464:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:0.0:1787604001.824515:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604001.824536:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19021cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5cff expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787604001.824562:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604001.824582:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1787604001.824587:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604001.824597:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19021cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cff expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.824626:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19021cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cff expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604001.824641:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595200, rc 0) 00000100:00100000:0.0:1787604001.824700:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2366:x1874438345806464:12345-192.168.202.21@tcp:101:bash.0 Request processed in 204us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604001.824707:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 59 00000100:00100000:0.0:1787604001.828319:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604001.828557:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345806592 00000100:00100000:2.0:1787604001.828566:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345806592 00000100:00100000:2.0:1787604001.828727:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 60 00000100:00100000:2.0:1787604001.828740:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b498b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:11567:x1874438345806592:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:2.0:1787604001.828784:0:10671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604001.828804:0:10671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d06 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.828875:0:10671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19021cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cff expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.828885:0:10671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604001.828891:0:10671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604001.828897:0:10671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 7 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.828951:0:10671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19021cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cff expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.828977:0:10671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19021cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cff expref: 7 pid: 6679 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604001.828992:0:10671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf210380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10671:1874438355232896:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787604001.829083:0:10671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28639d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787604001.832268:0:10671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf210380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10671:1874438355232896:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604001.832308:0:10671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 7 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.832330:0:10671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962200, rc 0) 00000100:00100000:2.0:1787604001.832602:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b498b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:11567:x1874438345806592:12345-192.168.202.21@tcp:101:bash.0 Request processed in 3863us (4289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604001.832621:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 60 00000100:00100000:1.0:1787604001.835602:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604001.835713:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345806720 00000100:00100000:2.0:1787604001.835725:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345806720 00010000:00010000:2.0:1787604001.835763:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19021cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cff expref: 7 pid: 6679 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604001.835954:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 74 00000100:00100000:2.0:1787604001.835965:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345806720:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787604001.835998:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604001.836018:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19021cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cff expref: 7 pid: 6679 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.836028:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19021cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cff expref: 7 pid: 6679 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.836050:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19021cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cff expref: 7 pid: 6679 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.836063:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604001.836067:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604001.836072:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 6 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.836078:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 6 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.836220:0:6693:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 6 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604001.836235:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf210380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6693:1874438355233024:192.168.202.21@tcp:105: 00000100:00100000:2.0:1787604001.836309:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28639d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787604001.838638:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf210380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6693:1874438355233024:192.168.202.21@tcp:105: 00010000:00010000:2.0:1787604001.838664:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604001.838736:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345806720:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 2772us (3145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604001.838746:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 74 00000100:00100000:3.0:1787604001.840401:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604001.840525:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345806976 00000100:00100000:1.0:1787604001.840536:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345806976 00000100:00100000:1.0:1787604001.840626:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 55 00000100:00100000:1.0:1787604001.840637:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+38:11567:x1874438345806976:12345-192.168.202.21@tcp:35:bash.0 00000100:00100000:1.0:1787604001.841015:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+39:11567:x1874438345806976:12345-192.168.202.21@tcp:35:bash.0 Request processed in 379us (621us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787604001.841023:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 55 00000100:00100000:1.0:1787604001.997486:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604001.997587:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345807104 00000100:00100000:2.0:1787604001.997598:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345807104 00000100:00100000:2.0:1787604001.997654:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 200 00000100:00100000:2.0:1787604001.997664:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+39:11583:x1874438345807104:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:2.0:1787604001.997686:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604001.997706:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a19021dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d0d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.997770:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a19021e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.997784:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a19021e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.997796:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a19021e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604001.997885:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787604001.997888:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787604001.997911:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a19021e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.997934:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a19021dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d0d expref: 41 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.997951:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a19021e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d0d expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604001.997975:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:2.0:1787604001.997978:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787604001.997981:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962000, rc 0) 00000100:00100000:2.0:1787604001.998039:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+40:11583:x1874438345807104:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 377us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604001.998046:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 200 00000100:00100000:0.0:1787604002.006332:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604002.006421:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345807360 00000100:00100000:3.0:1787604002.006431:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345807360 00000100:00100000:3.0:1787604002.006493:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 201 00000100:00100000:3.0:1787604002.006504:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b498b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+40:11583:x1874438345807360:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787604002.006526:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604002.006547:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19021eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d14 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.006644:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19021f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.006671:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19021f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.006682:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19021f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604002.006695:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787604002.006823:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19021eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d14 expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.006887:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19021f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d14 expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.006897:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed2b2e8ba00) 00010000:00010000:3.0:1787604002.006900:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787604002.006904:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad600, rc 0) 00000100:00100000:3.0:1787604002.006967:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b498b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+42:11583:x1874438345807360:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 465us (653us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787604002.006974:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 201 00000100:00100000:3.0:1787604002.012375:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604002.012440:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604002.012599:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345807616 00000100:00100000:2.0:1787604002.012610:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345807616 00000100:00100000:2.0:1787604002.012673:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 202 00000100:00100000:2.0:1787604002.012684:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+42:11583:x1874438345807616:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:2.0:1787604002.012709:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604002.012730:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902200 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d1b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.012826:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902207 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.012875:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902207 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.012886:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902207 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604002.012899:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787604002.013021:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902200 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d1b expref: 45 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.013057:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902207 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d1b expref: 44 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.013066:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed2b2e8ba00) 00010000:00010000:2.0:1787604002.013069:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787604002.013073:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962c00, rc 0) 00000100:00100000:2.0:1787604002.013132:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+44:11583:x1874438345807616:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 449us (767us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787604002.013138:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 202 00000100:00100000:0.0:1787604002.013735:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345807744 00000100:00100000:0.0:1787604002.013742:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345807744 00000100:00100000:0.0:1787604002.013792:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15 00000100:00100000:0.0:1787604002.013802:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2989fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+44:2364:x1874438345807744:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604002.013812:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604002.013860:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a19021f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d14 expref: 44 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.013875:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed2b2e8ba00) 00010000:00010000:0.0:1787604002.013879:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604002.013915:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2989fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+43:2364:x1874438345807744:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 114us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604002.013922:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15 00000100:00100000:3.0:1787604002.034178:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604002.034329:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345807872 00000100:00100000:2.0:1787604002.034339:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345807872 00000100:00100000:2.0:1787604002.034399:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 61 00000100:00100000:2.0:1787604002.034407:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+6:2363:x1874438345807872:12345-192.168.202.21@tcp:1:lfs.0 00010000:00010000:2.0:1787604002.034447:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.034466:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 6 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.034484:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787604002.034488:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787604002.034493:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.034528:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 6 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.034558:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 6 pid: 10671 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604002.034571:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf210380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1874438355233152:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787604002.034666:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28639d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787604002.037817:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf210380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1874438355233152:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787604002.037890:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604002.038343:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604002.038457:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345808000 00000100:00100000:1.0:1787604002.038464:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345808000 00002000:00100000:1.0:1787604002.038527:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ed2c1ec7800 x1874438345808000/t0(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:328/0 lens 504/0 e 0 to 0 dl 1787604013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787604002.038538:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2c1ec7800 with x1874438345808000 ext(0->8) 00010000:00010000:1.0:1787604002.038546:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 7 pid: 10671 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.038559:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 7 pid: 10671 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787604002.038566:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed2c1ec7800 00000100:00100000:1.0:1787604002.038598:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3 00000100:00100000:1.0:1787604002.038608:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2364:x1874438345808000:12345-192.168.202.21@tcp:4:lfs.0 00000100:00100000:1.0:1787604002.039133:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2364:x1874438345808000:12345-192.168.202.21@tcp:4:lfs.0 Request processed in 524us (790us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787604002.039141:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3 00002000:00100000:1.0:1787604002.039149:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ed2c1ec7800 x1874438345808000/t4294967308(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:328/0 lens 504/448 e 0 to 0 dl 1787604013 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787604002.039157:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2c1ec7800 with x1874438345808000 ext(0->8) 00010000:00010000:1.0:1787604002.039163:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 9 pid: 10671 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.039175:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 9 pid: 10671 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787604002.039182:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed2c1ec7800 00000100:00100000:2.0:1787604002.044120:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604002.044315:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345808128 00000100:00100000:3.0:1787604002.044330:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345808128 00010000:00010000:3.0:1787604002.044373:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 9 pid: 10671 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604002.044618:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 75 00000100:00100000:3.0:1787604002.044631:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2366:x1874438345808128:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787604002.044646:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787604002.044667:0:5807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787604002.044670:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787604001 00002000:00010000:3.0:1787604002.044672:0:5807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787604001 00002000:00010000:3.0:1787604002.044674:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787604001 00010000:00010000:3.0:1787604002.044680:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 9 pid: 10671 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.044693:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 9 pid: 10671 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.044716:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a19021d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d06 expref: 9 pid: 10671 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.044732:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787604002.044736:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787604002.044743:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.044753:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.044788:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787604002.044934:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2366:x1874438345808128:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 304us (823us total) trans 0 rc 0/0 00010000:00010000:1.0:1787604002.044990:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.045000:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.045022:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.045031:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.045039:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.045045:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963c00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787604002.045050:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.045058:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.045069:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.045076:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4bb278f/0xb5d1f3b1a1902215 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604002.045135:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2363:x1874438345807872:12345-192.168.202.21@tcp:1:lfs.0 Request processed in 10727us (10966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604002.045143:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 61 00000100:00100000:3.0:1787604002.045861:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 75 00000100:00100000:3.0:1787604002.051266:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.051573:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345808384 00000100:00100000:0.0:1787604002.051584:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345808384 00000100:00100000:0.0:1787604002.051678:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 56 00000100:00100000:0.0:1787604002.051690:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed291f93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+43:11583:x1874438345808384:12345-192.168.202.21@tcp:35:lfs.0 00000004:00010000:0.0:1787604002.051770:0:11963:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902207 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d1b expref: 43 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787604002.052349:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1787604002.052482:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1787604002.052806:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1787604002.053064:0:11963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.053084:0:11963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a19021c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cf8 expref: 47 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.053170:0:11963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.053277:0:11963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a19021c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cf8 expref: 47 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.053307:0:11963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a19021c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cf8 expref: 47 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604002.053322:0:11963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4989f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11963:1874438355233280:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787604002.053673:0:11963:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2951423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604002.056517:0:11963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4989f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11963:1874438355233280:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787604002.056553:0:11963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604002.057098:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.057283:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345808512 00000100:00100000:0.0:1787604002.057292:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345808512 00010000:00010000:0.0:1787604002.057333:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a19021c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cf8 expref: 48 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604002.057378:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 76 00000100:00100000:0.0:1787604002.057389:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+48:2363:x1874438345808512:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604002.057404:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604002.057410:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a19021c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cf8 expref: 48 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.057423:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a19021c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cf8 expref: 48 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.057445:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962800/0xb5d1f3b1a19021c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cf8 expref: 48 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.057492:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed2b2e8ba00) 00010000:00010000:0.0:1787604002.057498:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.057511:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.057519:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.057556:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787604002.057589:0:11963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.057596:0:11963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604002.057621:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+47:2363:x1874438345808512:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 233us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604002.057628:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 76 00000001:00080000:3.0:1787604002.057726:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787604002.057967:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1787604002.058076:0:11963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11963:1874438355233408:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787604002.058152:0:11963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604002.058178:0:11963:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28670a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787604002.058195:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355233408 00000100:00100000:3.0:1787604002.058199:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355233408 00000100:00100000:3.0:1787604002.058246:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787604002.058252:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11963:x1874438355233408:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787604002.058310:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11963:x1874438355233408:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 57us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604002.058325:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787604002.058341:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604002.058364:0:11963:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1787604002.058368:0:11963:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2ba1a9c00, transno 4294967307 00000100:00100000:3.0:1787604002.058379:0:11963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11963:1874438355233408:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787604002.060343:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787604002.060422:0:11963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11963:1874438355233536:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787604002.060498:0:11963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604002.060770:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355233536 00000100:00100000:2.0:1787604002.060779:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355233536 00000100:00100000:3.0:1787604002.060790:0:11963:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28670a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604002.060822:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787604002.060832:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11963:x1874438355233536:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787604002.061021:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11963:x1874438355233536:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 190us (526us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787604002.061028:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787604002.061039:0:11963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11963:1874438355233536:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1787604002.061092:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787604002.061127:0:11963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.061364:0:11963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.061373:0:11963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.061379:0:11963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604002.061382:0:11963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.061390:0:11963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.061406:0:11963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed2b2e8ba00) 00010000:00010000:3.0:1787604002.061408:0:11963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787604002.061413:0:11963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.061418:0:11963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a190221c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787604002.061670:0:11963:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787604002.061756:0:11963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1787604002.061772:0:11963:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335125934557ns, next at 336125933330ns, rc = 0 00000001:00080000:3.0:1787604002.061778:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787604002.061801:0:11963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed2b2e8ba00) 00010000:00010000:3.0:1787604002.061803:0:11963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787604002.061950:0:11963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902207 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d1b expref: 51 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604002.062075:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed291f93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:11583:x1874438345808384:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 10389us (10820us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787604002.062081:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 56 00000020:00080000:3.0:1787604002.062084:0:11963:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787604002.064339:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604002.064520:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345808640 00000100:00100000:1.0:1787604002.064531:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345808640 00000100:00100000:1.0:1787604002.064587:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 203 00000100:00100000:1.0:1787604002.064598:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+50:11583:x1874438345808640:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787604002.064620:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604002.064645:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902223 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d22 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.064704:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d22 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.064719:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d22 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.064741:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:1.0:1787604002.064744:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787604002.064748:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f000, rc 0) 00000100:00100000:1.0:1787604002.064865:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:11583:x1874438345808640:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 269us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604002.064872:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 203 00000100:00100000:1.0:1787604002.069610:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604002.069693:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345808896 00000100:00100000:3.0:1787604002.069703:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345808896 00000100:00100000:3.0:1787604002.069765:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 57 00000100:00100000:3.0:1787604002.069777:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+51:11583:x1874438345808896:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:3.0:1787604002.070043:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:11583:x1874438345808896:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 268us (443us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1787604002.070050:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 57 00000100:00100000:3.0:1787604002.167594:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604002.167874:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345809024 00000100:00100000:2.0:1787604002.167885:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345809024 00000100:00100000:2.0:1787604002.167946:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 204 00000100:00100000:2.0:1787604002.167956:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:11593:x1874438345809024:12345-192.168.202.21@tcp:34:lfs.0 00010000:00010000:2.0:1787604002.168032:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190222a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168048:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190222a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168067:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190222a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168105:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1902231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168113:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1902231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168119:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1902231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168214:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902238 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168222:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168228:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787604002.168271:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168286:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190222a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168293:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190222a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168301:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190222a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168307:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787604002.168312:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190222a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168325:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190222a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168338:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:2.0:1787604002.168341:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604002.168345:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190222a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168351:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a190222a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168364:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1902231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168370:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1902231 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168375:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1902231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168381:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787604002.168397:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1902231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168403:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1902231 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168410:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed2b2e8b700) 00010000:00010000:2.0:1787604002.168413:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604002.168416:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1902231 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168433:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a1902231 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168447:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168453:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902238 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168458:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168462:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787604002.168465:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168480:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902238 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168489:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:2.0:1787604002.168491:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604002.168494:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902238 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.168499:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902238 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604002.168591:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:11593:x1874438345809024:12345-192.168.202.21@tcp:34:lfs.0 Request processed in 635us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604002.168599:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 204 00010000:00010000:0.0:1787604002.199464:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604002.244175:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604002.244296:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345809280 00000100:00100000:1.0:1787604002.244322:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345809280 00000100:00100000:1.0:1787604002.244393:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 205 00000100:00100000:1.0:1787604002.244405:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+52:11596:x1874438345809280:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787604002.244424:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604002.244445:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a190223f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d29 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244542:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902246 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244557:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902246 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244568:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902246 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244585:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190224d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244592:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190224d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244598:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190224d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244733:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902254 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244742:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244749:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604002.244765:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787604002.244925:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902246 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244933:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902246 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244940:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902246 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244946:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fa00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604002.244950:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902246 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244957:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902246 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244969:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:1.0:1787604002.244972:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604002.244975:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902246 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244981:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a1902246 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.244994:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190224d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.245000:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190224d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.245014:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190224d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.245019:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7ec00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604002.245022:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190224d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.245028:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190224d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.245036:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed291bd5700) 00010000:00010000:1.0:1787604002.245038:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604002.245041:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190224d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.245046:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a190224d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.245097:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a190223f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d29 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.245114:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902254 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d29 expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.245121:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:1.0:1787604002.245123:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787604002.245126:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e800, rc 0) 00000100:00100000:1.0:1787604002.245194:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:11596:x1874438345809280:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 791us (1032us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787604002.245209:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 205 00000100:00100000:3.0:1787604002.250946:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604002.251738:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345809408 00000100:00100000:2.0:1787604002.251752:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345809408 00000100:00100000:2.0:1787604002.251950:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 206 00000100:00100000:2.0:1787604002.251962:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:11596:x1874438345809408:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:2.0:1787604002.252039:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902262 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.252057:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.252069:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.252107:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.252115:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902262 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.252120:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.252127:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787604002.252131:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.252138:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902262 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.252151:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:2.0:1787604002.252155:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787604002.252160:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902262 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.252183:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a1902262 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604002.252288:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:11596:x1874438345809408:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 328us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604002.252295:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 206 00000100:00100000:3.0:1787604002.256595:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.257710:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345809664 00000100:00100000:0.0:1787604002.257725:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345809664 00000100:00100000:0.0:1787604002.257862:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 58 00000100:00100000:0.0:1787604002.257874:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+54:11596:x1874438345809664:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:0.0:1787604002.258130:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:11596:x1874438345809664:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 258us (1544us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787604002.258138:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 58 00000100:00100000:0.0:1787604002.356952:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604002.357597:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345809920 00000100:00100000:1.0:1787604002.357609:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345809920 00000100:00100000:1.0:1787604002.357710:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 207 00000100:00100000:1.0:1787604002.357721:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:11606:x1874438345809920:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:1.0:1787604002.357746:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604002.357750:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787604002.357777:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a19021e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d0d expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.357798:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:1.0:1787604002.357803:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787604002.357817:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902269 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d30 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.357952:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.357967:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902254 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d29 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.357976:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.358008:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902254 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d29 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.358034:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902254 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d29 expref: 55 pid: 5822 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604002.358062:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bed4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355233664:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787604002.358175:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed299ed4780 going to sleep for 11 seconds 00000100:00100000:1.0:1787604002.363979:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.364058:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345810048 00000100:00100000:0.0:1787604002.364068:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345810048 00010000:00010000:0.0:1787604002.364122:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902254 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d29 expref: 56 pid: 5822 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604002.364179:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 77 00000100:00100000:0.0:1787604002.364189:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:2363:x1874438345810048:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604002.364212:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604002.364219:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902254 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d29 expref: 56 pid: 5822 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.364232:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902254 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d29 expref: 56 pid: 5822 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.364263:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:0.0:1787604002.364268:0:6693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.364278:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.364287:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.364308:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604002.364366:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+56:2363:x1874438345810048:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 178us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604002.364374:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 77 00010000:00010000:2.0:1787604002.365365:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902254 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d29 expref: 55 pid: 5822 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604002.365385:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bed4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355233664:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604002.365408:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.365416:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.365422:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604002.365443:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787604002.365939:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902269 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d30 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.365958:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d30 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.365966:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:2.0:1787604002.365969:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787604002.365984:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7ec00, rc 0) 00000100:00100000:2.0:1787604002.366041:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:11606:x1874438345809920:12345-192.168.202.21@tcp:101:bash.0 Request processed in 8321us (9098us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787604002.366050:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 207 00000100:00100000:1.0:1787604002.371029:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604002.371391:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345810304 00000100:00100000:2.0:1787604002.371403:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345810304 00000100:00100000:2.0:1787604002.371505:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 208 00000100:00100000:2.0:1787604002.371524:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+55:11606:x1874438345810304:12345-192.168.202.21@tcp:36:bash.0 00010000:00010000:2.0:1787604002.371794:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a190227e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.371811:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a190227e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.371822:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a190227e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787604002.372029:0:7875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787604002.372055:0:7875:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c3beceb reply state 00000000831abbe0 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a190227e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604002.372065:0:7875:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787604002.372156:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+58:11606:x1874438345810304:12345-192.168.202.21@tcp:36:bash.0 Request processed in 633us (1145us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787604002.372163:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 208 00000020:00080000:2.0:1787604002.372167:0:7875:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787604002.376376:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a190227e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.376395:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a190227e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.376402:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a190227e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.376419:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604002.376424:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a190227e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.376431:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a190227e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.376448:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:3.0:1787604002.376451:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604002.376456:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a190227e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.376461:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a190227e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604002.378494:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604002.378808:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345810432 00000100:00100000:2.0:1787604002.378820:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345810432 00000100:00100000:2.0:1787604002.378920:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 209 00000100:00100000:2.0:1787604002.378932:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+57:11606:x1874438345810432:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:2.0:1787604002.378968:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604002.378992:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1902285 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d37 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.379093:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.379108:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d30 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.379118:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.379151:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d30 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.379165:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d30 expref: 58 pid: 5822 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604002.379178:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf213800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355233792:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787604002.379274:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28639d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787604002.384402:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.384874:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345810560 00000100:00100000:0.0:1787604002.384885:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345810560 00010000:00010000:0.0:1787604002.384931:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d30 expref: 59 pid: 5822 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604002.384997:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 78 00000100:00100000:0.0:1787604002.385008:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:2363:x1874438345810560:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604002.385103:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604002.385112:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d30 expref: 59 pid: 5822 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.385127:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d30 expref: 59 pid: 5822 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.385153:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:0.0:1787604002.385159:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.385169:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.385176:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.385196:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787604002.385490:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902270 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d30 expref: 59 pid: 5822 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604002.385516:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf213800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874438355233792:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604002.385537:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.385556:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.385562:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604002.385608:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787604002.385613:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787604002.385633:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.385662:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1902285 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d37 expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.385677:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d37 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.385685:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:2.0:1787604002.385688:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787604002.385690:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963200, rc 0) 00000100:00100000:2.0:1787604002.385734:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+58:11606:x1874438345810432:12345-192.168.202.21@tcp:101:bash.0 Request processed in 6804us (7250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604002.385742:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 209 00000100:00100000:0.0:1787604002.385989:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+57:2363:x1874438345810560:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 982us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604002.385997:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 78 00000100:00100000:1.0:1787604002.397008:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604002.397132:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345810816 00000100:00100000:3.0:1787604002.397142:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345810816 00000100:00100000:3.0:1787604002.397204:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 59 00000100:00100000:3.0:1787604002.397215:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+57:11606:x1874438345810816:12345-192.168.202.21@tcp:35:bash.0 00000100:00100000:3.0:1787604002.397479:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+58:11606:x1874438345810816:12345-192.168.202.21@tcp:35:bash.0 Request processed in 257us (472us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787604002.397487:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 59 00000100:00100000:2.0:1787604002.564887:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604002.564970:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345810944 00000100:00100000:3.0:1787604002.564981:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345810944 00000100:00100000:3.0:1787604002.565041:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 210 00000100:00100000:3.0:1787604002.565051:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+58:11612:x1874438345810944:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787604002.565075:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604002.565110:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902293 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d3e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.565191:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190229a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.565206:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190229a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.565218:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190229a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604002.565286:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787604002.565291:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787604002.565316:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190229a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.565340:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902293 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d3e expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.565365:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190229a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d3e expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.565375:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:3.0:1787604002.565379:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787604002.565383:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac200, rc 0) 00000100:00100000:3.0:1787604002.565552:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:11612:x1874438345810944:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 501us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604002.565559:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 210 00000100:00100000:2.0:1787604002.572644:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604002.576728:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345811072 00000100:00100000:1.0:1787604002.576744:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345811072 00000100:00100000:1.0:1787604002.576826:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 211 00000100:00100000:1.0:1787604002.576873:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:11612:x1874438345811072:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787604002.576893:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604002.576916:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a19022a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d45 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.576981:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19022a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577001:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19022a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577013:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19022a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577028:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a19022af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577034:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a19022af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577057:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a19022af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577324:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19022b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577334:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19022b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577342:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19022b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604002.577497:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787604002.577502:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787604002.577525:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19022b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577537:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19022b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577544:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19022a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577550:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19022a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577557:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19022a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577563:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7ec00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604002.577567:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19022a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577582:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19022a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577594:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:1.0:1787604002.577597:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604002.577602:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19022a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577608:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a19022a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577619:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a19022af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577625:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a19022af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577632:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a19022af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577637:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604002.577640:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a19022af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577645:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a19022af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577652:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed291bd5700) 00010000:00010000:1.0:1787604002.577654:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604002.577656:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a19022af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577672:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a19022af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577704:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7fa00/0xb5d1f3b1a19022a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d45 expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577716:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19022b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d45 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.577723:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:1.0:1787604002.577725:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787604002.577727:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e800, rc 0) 00000100:00100000:1.0:1787604002.577874:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:11612:x1874438345811072:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 1001us (5203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604002.577882:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 211 00000100:00100000:0.0:1787604002.585708:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.585789:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.585832:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345811456 00000100:00100000:0.0:1787604002.585863:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345811456 00000100:00100000:0.0:1787604002.585943:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:0.0:1787604002.585953:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b498bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:2363:x1874438345811456:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604002.585969:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604002.585995:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19022b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d45 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.586026:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:0.0:1787604002.586031:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604002.586081:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b498bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:2363:x1874438345811456:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 129us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604002.586097:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:2.0:1787604002.586881:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345811328 00000100:00100000:2.0:1787604002.586888:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345811328 00000100:00100000:2.0:1787604002.591244:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 212 00000100:00100000:2.0:1787604002.591278:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:11612:x1874438345811328:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:2.0:1787604002.591300:0:7875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604002.591501:0:7875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a19022bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d4c expref: -99 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.591679:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.591695:0:7875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d37 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.591703:0:7875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.591738:0:7875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d37 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.591751:0:7875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d37 expref: 60 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604002.591766:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf211880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355233920:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787604002.595352:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28639d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787604002.600737:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.600827:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345811584 00000100:00100000:0.0:1787604002.600865:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345811584 00010000:00010000:0.0:1787604002.601113:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d37 expref: 61 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604002.601157:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 79 00000100:00100000:0.0:1787604002.601168:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+61:2364:x1874438345811584:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604002.601183:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604002.601190:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d37 expref: 61 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.601204:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d37 expref: 61 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.601227:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:0.0:1787604002.601232:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.601258:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.601265:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.601285:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604002.601344:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+61:2364:x1874438345811584:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 178us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604002.601352:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 79 00010000:00010000:1.0:1787604002.601714:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a190228c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d37 expref: 60 pid: 5823 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604002.601730:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf211880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355233920:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787604002.601749:0:7875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.601757:0:7875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.601762:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604002.601791:0:7875:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787604002.602199:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a19022bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d4c expref: 61 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.602216:0:7875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d4c expref: 60 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.602223:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:1.0:1787604002.602226:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787604002.602229:0:7875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962e00, rc 0) 00000100:00100000:1.0:1787604002.602314:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:11612:x1874438345811328:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 11043us (16627us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787604002.602323:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 212 00000100:00100000:2.0:1787604002.606827:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.607304:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345811840 00000100:00100000:0.0:1787604002.607314:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345811840 00000100:00100000:0.0:1787604002.607450:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:0.0:1787604002.607462:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2989fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:11612:x1874438345811840:12345-192.168.202.21@tcp:103:lfs.0 00010000:00010000:0.0:1787604002.607488:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604002.607513:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a1902223 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d22 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.607530:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:0.0:1787604002.607535:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604002.607692:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2989fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:11612:x1874438345811840:12345-192.168.202.21@tcp:103:lfs.0 Request processed in 233us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604002.607698:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:0.0:1787604002.611301:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604002.611476:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345811968 00000100:00100000:2.0:1787604002.611486:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345811968 00000100:00100000:2.0:1787604002.611584:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 213 00000100:00100000:2.0:1787604002.611593:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b498bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:11612:x1874438345811968:12345-192.168.202.21@tcp:58:lfs.0 00010000:00010000:2.0:1787604002.611707:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a19022d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.611726:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a19022d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.611735:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a19022d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787604002.612011:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787604002.612097:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b498bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:11612:x1874438345811968:12345-192.168.202.21@tcp:58:lfs.0 Request processed in 505us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604002.612106:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 213 00000100:00100000:2.0:1787604002.618181:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.618275:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345812096 00000100:00100000:0.0:1787604002.618287:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345812096 00000100:00100000:0.0:1787604002.618693:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 214 00000100:00100000:0.0:1787604002.618720:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+59:11612:x1874438345812096:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787604002.618743:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604002.618763:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19022d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d53 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.618861:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a19022d2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.618873:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19022d9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d53 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.618894:0:5821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a19022d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.618908:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19022d9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d53 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.618934:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:0.0:1787604002.618937:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787604002.618942:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19022d9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d53 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.618950:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594e00, rc 0) 00000100:00100000:0.0:1787604002.619011:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:11612:x1874438345812096:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 293us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604002.619019:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 214 00000040:00080000:0.0:1787604002.906100:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787604002.906109:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787604002.906183:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787604002.906192:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787604002.906315:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4989c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874438355234048:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787604002.906437:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295142180 going to sleep for 11 seconds 00000100:00100000:0.0:1787604002.911408:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4989c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874438355234048:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787604002.922726:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604002.923053:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345812224 00000100:00100000:1.0:1787604002.923065:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345812224 00000100:00100000:1.0:1787604002.923137:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 215 00000100:00100000:1.0:1787604002.923148:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:11613:x1874438345812224:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787604002.923181:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787604002.923300:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:11613:x1874438345812224:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 Request processed in 153us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604002.923314:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 215 00000100:00100000:3.0:1787604002.930352:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.930432:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345812352 00000100:00100000:0.0:1787604002.930444:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345812352 00000100:00100000:0.0:1787604002.930517:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 216 00000100:00100000:0.0:1787604002.930529:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:11613:x1874438345812352:12345-192.168.202.21@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787604002.930603:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19022e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930620:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19022e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930631:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19022e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930695:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a19022e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930703:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a19022e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930710:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a19022e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930735:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19022ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930757:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19022ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930764:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19022ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787604002.930814:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787604002.930818:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787604002.930831:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19022ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930874:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19022e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930882:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19022e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930888:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19022e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930894:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604002.930898:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19022e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930905:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19022e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930917:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed290d35200) 00010000:00010000:0.0:1787604002.930920:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604002.930925:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19022e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930941:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594400/0xb5d1f3b1a19022e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930955:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a19022e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930960:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a19022e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930966:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a19022e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930970:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604002.930974:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a19022e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930980:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a19022e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.930989:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9ed28870b100) 00010000:00010000:0.0:1787604002.930991:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604002.930994:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a19022e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.931000:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a19022e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.931013:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19022ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.931018:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19022ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.931030:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19022ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.931035:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604002.931038:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19022ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.931043:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19022ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.931050:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:0.0:1787604002.931053:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604002.931055:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19022ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.931061:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a19022ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604002.938181:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:11613:x1874438345812352:12345-192.168.202.21@tcp:34:lhsmtool_posix.0 Request processed in 7642us (7826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604002.938781:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 216 00000100:00100000:3.0:1787604002.942662:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604002.943078:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345812608 00000100:00100000:2.0:1787604002.943090:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345812608 00000100:00100000:2.0:1787604002.943149:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 217 00000100:00100000:2.0:1787604002.943160:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+60:11613:x1874438345812608:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787604002.943182:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604002.943216:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a19022f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.943608:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19022fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.943624:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19022fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.943637:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19022fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604002.943666:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787604002.943785:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19022fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.943793:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19022fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.943807:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19022fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.943815:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787604002.943819:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19022fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.943827:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19022fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.944030:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:2.0:1787604002.944034:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787604002.944039:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19022fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.944045:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19022fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.944092:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a19022f5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d5a expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.944103:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed290d35200) 00010000:00010000:2.0:1787604002.944105:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787604002.944116:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a19022f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d5a expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.944127:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963c00, rc 0) 00000100:00100000:2.0:1787604002.944182:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+61:11613:x1874438345812608:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 1024us (1532us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787604002.944189:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 217 00000100:00100000:2.0:1787604002.954146:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604002.954397:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345812736 00000100:00100000:1.0:1787604002.954407:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345812736 00000100:00100000:1.0:1787604002.954564:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 218 00000100:00100000:1.0:1787604002.954576:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+61:11613:x1874438345812736:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787604002.954626:0:7875:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787604002.954753:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+61:11613:x1874438345812736:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 Request processed in 178us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604002.954760:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 218 00000100:00100000:1.0:1787604002.960693:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604002.960783:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345812992 00000100:00100000:2.0:1787604002.960793:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345812992 00000100:00100000:2.0:1787604002.961026:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 219 00000100:00100000:2.0:1787604002.961039:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+61:11613:x1874438345812992:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787604002.961058:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604002.961061:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787604002.961086:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a190229a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d3e expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.961106:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:2.0:1787604002.961111:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787604002.961125:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a190230a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d61 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787604002.967038:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787604002.967622:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.967639:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.967668:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.967829:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962200/0xb5d1f3b1a190230a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d61 expref: 63 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.968136:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d61 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604002.968147:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed2b2e8b700) 00010000:00010000:2.0:1787604002.968149:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787604002.968153:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963c00, rc 0) 00000100:00100000:2.0:1787604002.968652:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+62:11613:x1874438345812992:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 7613us (7972us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787604002.968662:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 219 00000100:00100000:3.0:1787604002.972578:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.974048:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345813248 00000100:00100000:0.0:1787604002.974063:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345813248 00000100:00100000:0.0:1787604002.974132:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 220 00000100:00100000:0.0:1787604002.974150:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+62:11613:x1874438345813248:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787604002.974217:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604002.974244:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902311 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d61 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974298:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed2b2e8b700) 00010000:00010000:0.0:1787604002.974319:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787604002.974340:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a190231f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974353:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a190231f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974361:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a190231f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974375:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1902326 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd140687a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974381:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1902326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd140687a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974387:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1902326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd140687a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974454:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a190231f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974475:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a190231f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974483:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a190231f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974488:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604002.974493:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a190231f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974507:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a190231f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974516:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787604002.974519:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604002.974523:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a190231f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974528:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a190231f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974537:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1902326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd140687a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974542:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1902326 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd140687a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974548:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1902326 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd140687a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974553:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604002.974556:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1902326 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd140687a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974561:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1902326 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd140687a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974567:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd140687a (ffff9ed28870b100) 00010000:00010000:0.0:1787604002.974569:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604002.974572:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1902326 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd140687a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.974587:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595e00/0xb5d1f3b1a1902326 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd140687a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604002.974693:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+61:11613:x1874438345813248:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 536us (2117us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787604002.974701:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 220 00000100:00100000:0.0:1787604002.979243:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604002.979400:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345813376 00000100:00100000:1.0:1787604002.979412:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345813376 00000100:00100000:1.0:1787604002.979481:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 221 00000100:00100000:1.0:1787604002.979492:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+61:11613:x1874438345813376:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787604002.979510:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604002.979531:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a190232d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d68 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.979563:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902334 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.979576:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.979587:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.979694:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a190232d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d68 expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.979713:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d68 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.979734:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed291bd5700) 00010000:00010000:1.0:1787604002.979737:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787604002.979741:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7ec00, rc 0) 00000100:00100000:1.0:1787604002.979809:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+62:11613:x1874438345813376:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 312us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604002.979817:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 221 00000100:00100000:3.0:1787604002.984102:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604002.984752:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345813632 00000100:00100000:0.0:1787604002.984765:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345813632 00000100:00100000:0.0:1787604002.984822:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 222 00000100:00100000:0.0:1787604002.984833:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+62:11613:x1874438345813632:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787604002.985823:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190233b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.987106:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190233b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604002.987124:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190233b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787604002.987396:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1787604002.987407:0:5821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336051569240ns, next at 337051566898ns, rc = 0 00000004:00010000:0.0:1787604002.989656:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002520af9 reply state 00000000a0527d33 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190233b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604002.989678:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787604002.990154:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+64:11613:x1874438345813632:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 5318us (6057us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787604002.990179:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 222 00010000:00010000:3.0:1787604002.993552:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190233b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.993571:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190233b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.993579:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190233b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.993585:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604002.993591:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190233b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.993598:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190233b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.993616:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed291bd5700) 00010000:00010000:3.0:1787604002.993620:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787604002.993624:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190233b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604002.993630:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594800/0xb5d1f3b1a190233b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604002.994003:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604002.994154:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345813760 00000100:00100000:1.0:1787604002.994163:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345813760 00000100:00100000:1.0:1787604002.994214:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 223 00000100:00100000:1.0:1787604002.994224:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b498a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+63:11613:x1874438345813760:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787604002.994247:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604002.994262:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902342 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d6f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.994334:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902342 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d6f expref: 64 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.994344:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902342 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d6f expref: 64 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604002.994359:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed291bd5700) 00010000:00010000:1.0:1787604002.994361:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787604002.994364:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f600, rc 0) 00000100:00100000:1.0:1787604002.994415:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b498a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+64:11613:x1874438345813760:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 193us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604002.994438:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 223 00000100:00100000:2.0:1787604002.998063:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604002.998163:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345813888 00000100:00100000:3.0:1787604002.998175:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345813888 00000100:00100000:3.0:1787604002.998262:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 62 00000100:00100000:3.0:1787604002.998343:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2363:x1874438345813888:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787604002.998770:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:2363:x1874438345813888:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 Request processed in 428us (717us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787604002.998778:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 62 00000100:00100000:3.0:1787604003.011540:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604003.011998:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345814144 00000100:00100000:0.0:1787604003.012010:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345814144 00000100:00100000:0.0:1787604003.012116:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 60 00000100:00100000:1.0:1787604003.012149:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+64:11613:x1874438345814144:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000100:00080000:3.0:1787604003.012170:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787604003.012396:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+65:11613:x1874438345814144:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 268us (867us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787604003.012405:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 60 00000100:00100000:1.0:1787604003.020135:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604003.020391:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345814400 00000100:00100000:2.0:1787604003.020405:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345814400 00000100:00100000:2.0:1787604003.020552:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 224 00000100:00100000:2.0:1787604003.020564:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+65:11613:x1874438345814400:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787604003.020682:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+65:11613:x1874438345814400:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 119us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604003.020698:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 224 00000100:00100000:2.0:1787604003.026285:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604003.026436:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345814528 00000100:00100000:3.0:1787604003.026451:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345814528 00000100:00100000:3.0:1787604003.026528:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 225 00000100:00100000:3.0:1787604003.026549:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+65:11613:x1874438345814528:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787604003.026571:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604003.026591:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902349 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d76 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.026658:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902350 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.026670:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.026679:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604003.026725:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787604003.026742:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.026763:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902349 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d76 expref: 67 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.026810:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902350 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d76 expref: 66 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.026820:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed291bd5700) 00010000:00010000:3.0:1787604003.026823:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787604003.026827:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac200, rc 0) 00000100:00100000:3.0:1787604003.027091:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+66:11613:x1874438345814528:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 543us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604003.027098:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 225 00000100:00100000:3.0:1787604003.030717:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604003.030790:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345814656 00000100:00100000:0.0:1787604003.031042:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345814656 00000100:00100000:1.0:1787604003.031166:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 63 00000100:00100000:1.0:1787604003.031181:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+10:2364:x1874438345814656:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00000100:00080000:2.0:1787604003.031248:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787604003.032282:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604003.032319:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a1902357 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d7d expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787604003.032348:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8cac22, blocks: 0x1 00010000:00010000:1.0:1787604003.032365:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1787604003.032369:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787604003.032377:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a1902357 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d7d expref: 11 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.032392:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a1902357 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d7d expref: 11 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.032403:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e400, rc 0) 00000100:00100000:1.0:1787604003.032459:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:2364:x1874438345814656:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 1282us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604003.032493:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 63 00000100:00100000:1.0:1787604003.038490:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604003.038570:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345814912 00000100:00100000:0.0:1787604003.038579:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345814912 00000100:00100000:0.0:1787604003.038638:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 226 00000100:00100000:0.0:1787604003.038648:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+66:11613:x1874438345814912:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787604003.038763:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+66:11613:x1874438345814912:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 117us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604003.038770:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 226 00000100:00100000:2.0:1787604003.045584:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604003.045667:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345815040 00000100:00100000:0.0:1787604003.045679:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345815040 00000100:00100000:0.0:1787604003.045973:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 64 00000100:00100000:0.0:1787604003.045984:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:11613:x1874438345815040:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787604003.046002:0:10671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604003.046020:0:10671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d84 expref: -99 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.046052:0:10671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a1902357 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d7d expref: 12 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.046061:0:10671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604003.046072:0:10671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604003.046077:0:10671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d84 expref: 12 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.046113:0:10671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a1902357 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d7d expref: 12 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.046127:0:10671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a1902357 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d7d expref: 12 pid: 6676 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604003.046142:0:10671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4988a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10671:1874438355234176:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787604003.046261:0:10671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295142180 going to sleep for 11 seconds 00000100:00100000:0.0:1787604003.049412:0:10671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4988a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10671:1874438355234176:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787604003.049449:0:10671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d84 expref: 12 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.049489:0:10671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595e00, rc 0) 00000100:00100000:0.0:1787604003.049557:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+12:11613:x1874438345815040:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 3574us (3978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604003.049567:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 64 00000100:00100000:1.0:1787604003.051108:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604003.052647:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345815168 00000100:00100000:3.0:1787604003.052662:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345815168 00010000:00010000:3.0:1787604003.052945:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a1902357 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d7d expref: 12 pid: 6676 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604003.053063:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 80 00000100:00100000:3.0:1787604003.053075:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+12:2363:x1874438345815168:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787604003.053100:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604003.053126:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a1902357 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d7d expref: 12 pid: 6676 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.053141:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a1902357 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d7d expref: 12 pid: 6676 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.053162:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a1902357 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d7d expref: 12 pid: 6676 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.053204:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604003.053209:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604003.053219:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d84 expref: 11 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.053232:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d84 expref: 11 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.053287:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d84 expref: 11 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604003.053301:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1874438355234304:192.168.202.21@tcp:105: 00000100:00100000:3.0:1787604003.053536:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28670a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787604003.061648:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1874438355234304:192.168.202.21@tcp:105: 00010000:00010000:2.0:1787604003.061677:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604003.061731:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:2363:x1874438345815168:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 8658us (10630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604003.061742:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 80 00000100:00100000:1.0:1787604003.062031:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604003.062120:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345815296 00000100:00100000:2.0:1787604003.062128:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345815296 00002000:00100000:2.0:1787604003.062173:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9ed2bed4ed80 x1874438345815296/t0(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:329/0 lens 504/0 e 0 to 0 dl 1787604014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787604003.062185:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2bed4ed80 with x1874438345815296 ext(0->12) 00002000:00010000:2.0:1787604003.062191:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2bed4ed80 00000100:00100000:2.0:1787604003.062222:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:2.0:1787604003.062232:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+11:2363:x1874438345815296:12345-192.168.202.21@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787604003.062727:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:2363:x1874438345815296:12345-192.168.202.21@tcp:4:lhsmtool_posix.0 Request processed in 494us (695us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787604003.062736:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6 00002000:00100000:2.0:1787604003.062743:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9ed2bed4ed80 x1874438345815296/t4294967320(0) o4->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:329/0 lens 504/448 e 0 to 0 dl 1787604014 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787604003.062752:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2bed4ed80 with x1874438345815296 ext(0->12) 00002000:00010000:2.0:1787604003.062755:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2bed4ed80 00000100:00100000:1.0:1787604003.066088:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604003.066446:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345815424 00000100:00100000:0.0:1787604003.066457:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345815424 00000100:00100000:0.0:1787604003.066533:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 227 00000100:00100000:0.0:1787604003.066544:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+66:11613:x1874438345815424:12345-192.168.202.21@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787604003.125674:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1787604003.125691:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:3.0:1787604003.125996:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787604003.126022:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355234560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787604003.126107:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604003.126155:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355234560 00000100:00100000:3.0:1787604003.126164:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355234560 00000100:00100000:1.0:1787604003.126488:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355234432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787604003.126520:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604003.126557:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355234432 00000100:00100000:1.0:1787604003.126562:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355234432 00000100:00100000:1.0:1787604003.126601:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787604003.126609:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355234432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787604003.126633:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1787604003.126658:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.126680:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e08efd82/0xb5d1f3b1a1902127 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ce3 expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.126689:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787604003.126694:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787604003.126699:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.126727:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e08efd82/0xb5d1f3b1a1902127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ce3 expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.126755:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e08efd82/0xb5d1f3b1a1902127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ce3 expref: 12 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604003.126769:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bed4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874438355234688:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787604003.126825:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed299d19480 going to sleep for 11 seconds 00000100:00100000:3.0:1787604003.127473:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787604003.127483:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3282:x1874438355234560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787604003.127650:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787604003.127654:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787604002 00002000:00010000:3.0:1787604003.127656:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787604003.127658:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787604002 -> 1787604002 00002000:00010000:3.0:1787604003.127661:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787604003.127720:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3282:x1874438355234560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 239us (1612us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787604003.127728:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1787604003.127774:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2c1ec4000/2, rc 0, transno 4294967321 00000100:00100000:3.0:1787604003.127780:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355234560:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1787604003.128098:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787604003.128248:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1787604003.128350:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2b9ef2d80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787604003.128354:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed28658e900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2b9ef2900 00000020:00080000:1.0:1787604003.128358:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed28658ea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2b4bfec00 00000004:00080000:1.0:1787604003.128397:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1787604003.128410:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787604003.128422:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed28670a180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787604003.128425:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed2bec2d100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed28670a3c0 00000020:00080000:1.0:1787604003.128428:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed2bec2d700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2af09c400 00000020:00080000:2.0:1787604003.128575:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787604003.128736:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787604003.128867:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b6138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355234816:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787604003.128907:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604003.128961:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355234816 00000100:00100000:1.0:1787604003.128967:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355234816 00000100:00100000:1.0:1787604003.128999:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787604003.129006:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1874438355234816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787604003.129026:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1787604003.129052:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8cac21, atime: 0x6a8cac21, ctime: 0x6a8cac21, blocks: 0x1 00010000:00010000:1.0:1787604003.129060:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a28ef194/0xb5d1f3b1a190236c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.129404:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1787604003.129408:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787604003.129415:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a28ef194/0xb5d1f3b1a190236c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.129430:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a28ef194/0xb5d1f3b1a190236c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.129440:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a28ef194/0xb5d1f3b1a190236c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.129447:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a28ef194/0xb5d1f3b1a190236c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.129480:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604003.130401:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604003.130411:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a28ef194/0xb5d1f3b1a190236c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.130429:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e800 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604003.130434:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a28ef194/0xb5d1f3b1a190236c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.130443:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a28ef194/0xb5d1f3b1a190236c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.130475:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a28ef194/0xb5d1f3b1a190236c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.130484:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a28ef194/0xb5d1f3b1a190236c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.130505:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604003.130506:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604003.130508:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604003.131209:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:11613:x1874438345815424:12345-192.168.202.21@tcp:44:lhsmtool_posix.0 Request processed in 64652us (65118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604003.131230:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 227 00000100:00100000:0.0:1787604003.133772:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604003.133811:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345815552 00000100:00100000:0.0:1787604003.133822:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345815552 00000100:00100000:2.0:1787604003.134332:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bed4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874438355234688:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604003.134358:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.134767:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e08efd82/0xb5d1f3b1a1902127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ce3 expref: 13 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604003.134826:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 81 00000100:00100000:0.0:1787604003.134875:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4988a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+13:2363:x1874438345815552:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604003.134893:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604003.134899:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e08efd82/0xb5d1f3b1a1902127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ce3 expref: 13 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.134912:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e08efd82/0xb5d1f3b1a1902127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ce3 expref: 13 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.134938:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e08efd82/0xb5d1f3b1a1902127 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ce3 expref: 13 pid: 6676 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.134957:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787604003.134961:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787604003.134967:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.134975:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.135016:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604003.135097:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4988a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+12:2363:x1874438345815552:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 250us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604003.135106:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 81 00000100:00100000:0.0:1787604003.135167:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604003.135868:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1874438355234816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6831us (6929us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787604003.135879:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787604003.135915:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345815680 00000100:00100000:1.0:1787604003.135923:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345815680 00000100:00100000:1.0:1787604003.135965:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 68 00000100:00100000:1.0:1787604003.135975:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+12:2364:x1874438345815680:12345-192.168.202.21@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1787604003.138056:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.138079:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.138122:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.138130:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.138149:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604003.141091:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604003.141109:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.141127:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7fa00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604003.141135:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.141149:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.141183:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.141192:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e72b4f1b/0xb5d1f3b1a1902365 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.141557:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604003.141575:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604003.141577:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604003.141852:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3284:x1874438355234432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15220us (15308us total) trans 4294967322 rc 0/0 00000004:00080000:0.0:1787604003.143162:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2c1ec5880/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787604003.143178:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355234432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787604003.143538:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1787604003.148659:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2b6138380/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787604003.148678:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b6138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355234816:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1787604003.185199:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1787604003.185216:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:0.0:1787604003.185226:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:0.0:1787604003.185231:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1787604003.185409:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2364:x1874438345815680:12345-192.168.202.21@tcp:16:lhsmtool_posix.0 Request processed in 49428us (50234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604003.185421:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 68 00000100:00100000:0.0:1787604003.188146:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604003.188690:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345815936 00000100:00100000:3.0:1787604003.188701:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345815936 00000100:00100000:3.0:1787604003.188816:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 228 00000100:00100000:3.0:1787604003.188828:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b498ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:11613:x1874438345815936:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787604003.188911:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604003.188937:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902350 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d76 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.188957:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed291bd5700) 00010000:00010000:3.0:1787604003.188963:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787604003.188995:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902373 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.189010:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902373 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.189020:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902373 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787604003.189333:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000774e1362 reply state 00000000c68f82db transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902373 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604003.189344:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787604003.189600:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b498ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:11613:x1874438345815936:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 774us (1465us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787604003.189608:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 228 00000100:00100000:0.0:1787604003.192737:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604003.192816:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345816064 00000100:00100000:1.0:1787604003.192826:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345816064 00010000:00010000:3.0:1787604003.192882:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902373 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.192897:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902373 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.192904:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902373 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604003.192906:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 69 00010000:00010000:3.0:1787604003.192911:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604003.192916:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902373 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604003.192917:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345816064:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1787604003.192924:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902373 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.192944:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed291bd5700) 00010000:00010000:3.0:1787604003.192947:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604003.192952:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902373 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.192958:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a1902373 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787604003.193259:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787604003.193263:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787604002 -> 1787604002 00002000:00010000:1.0:1787604003.193266:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787604001 00002000:00010000:1.0:1787604003.193268:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787604002 -> 1787604002 00002000:00010000:1.0:1787604003.193271:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787604003.193342:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2363:x1874438345816064:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 Request processed in 426us (615us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787604003.193349:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 69 00000100:00100000:1.0:1787604003.195573:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604003.195666:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345816320 00000100:00100000:3.0:1787604003.195675:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345816320 00000100:00100000:3.0:1787604003.195742:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 229 00000100:00100000:3.0:1787604003.195753:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:11613:x1874438345816320:12345-192.168.202.21@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787604003.196045:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.196065:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902334 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d68 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.196075:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.196112:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d68 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.196127:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902334 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d68 expref: 20 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604003.196143:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf414a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355234944:192.168.202.21@tcp:104: 00000100:00100000:3.0:1787604003.196435:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28670a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787604003.199052:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604003.199793:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf414a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1874438355234944:192.168.202.21@tcp:104: 00010000:00010000:3.0:1787604003.199994:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604003.200083:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345816448 00000100:00100000:2.0:1787604003.200093:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345816448 00010000:00010000:2.0:1787604003.200139:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902334 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d68 expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604003.200403:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 82 00000100:00100000:2.0:1787604003.200414:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:2363:x1874438345816448:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787604003.200432:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604003.200440:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902334 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d68 expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.200454:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d68 expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.200559:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902334 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d68 expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.200576:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed291bd5700) 00010000:00010000:2.0:1787604003.200581:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.200591:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.200618:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.200653:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604003.200714:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:2363:x1874438345816448:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 301us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604003.200721:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 82 00010000:00010000:0.0:1787604003.200779:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.200787:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.200826:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.200833:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.200855:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.200884:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604003.200889:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.200896:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.200905:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed291bd5700) 00010000:00010000:0.0:1787604003.200908:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787604003.200911:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.200917:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad600/0xb5d1f3b1a190237a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604003.200972:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:11613:x1874438345816320:12345-192.168.202.21@tcp:55:lhsmtool_posix.0 Request processed in 5220us (5407us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787604003.200980:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 229 00000100:00100000:0.0:1787604003.205735:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604003.205815:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345816576 00000100:00100000:2.0:1787604003.205827:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345816576 00000100:00100000:2.0:1787604003.205919:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 70 00000100:00100000:2.0:1787604003.205931:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2365:x1874438345816576:12345-192.168.202.21@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787604003.205988:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.206011:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d84 expref: 8 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.206021:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604003.206026:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787604003.206030:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.206067:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d84 expref: 8 pid: 10671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.206082:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d84 expref: 8 pid: 10671 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604003.206113:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874438355235072:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787604003.206207:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28639d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787604003.209831:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874438355235072:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604003.209894:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604003.212425:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604003.213032:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345816704 00000100:00100000:2.0:1787604003.213043:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345816704 00010000:00010000:0.0:1787604003.213171:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d84 expref: 9 pid: 10671 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604003.213426:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 83 00000100:00100000:0.0:1787604003.213439:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+9:2364:x1874438345816704:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604003.213455:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604003.213558:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d84 expref: 9 pid: 10671 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.213592:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d84 expref: 9 pid: 10671 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.213620:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e94d8ad/0xb5d1f3b1a190235e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d84 expref: 9 pid: 10671 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.213638:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787604003.213642:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787604003.213649:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.213659:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.213701:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604003.213819:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2364:x1874438345816704:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 382us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604003.213828:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 83 00010000:00010000:1.0:1787604003.214137:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.214150:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.214176:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.214186:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.214196:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.214211:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787604003.214216:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.214225:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.214240:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.214248:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047191f73/0xb5d1f3b1a1902381 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604003.214303:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2365:x1874438345816576:12345-192.168.202.21@tcp:1:lhsmtool_posix.0 Request processed in 8374us (8578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604003.214311:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 70 00000100:00100000:1.0:1787604003.219285:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604003.219391:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345816960 00000100:00100000:2.0:1787604003.219404:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345816960 00000100:00100000:2.0:1787604003.219472:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 230 00000100:00100000:2.0:1787604003.219498:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:11613:x1874438345816960:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787604003.219579:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902388 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.219599:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902388 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.219614:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902388 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.219910:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.219923:0:7875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902342 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d6f expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.219952:0:7875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.219994:0:7875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902342 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d6f expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.220006:0:7875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902342 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d6f expref: 20 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604003.220019:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355235200:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787604003.220107:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28639d540 going to sleep for 11 seconds 00010000:00010000:0.0:1787604003.223648:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604003.224169:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604003.224221:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355235200:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604003.224248:0:7875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604003.224440:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345817088 00000100:00100000:3.0:1787604003.224450:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345817088 00010000:00010000:3.0:1787604003.224590:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902342 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d6f expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604003.224629:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 84 00000100:00100000:3.0:1787604003.224638:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bed4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:2364:x1874438345817088:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787604003.224654:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604003.224662:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902342 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d6f expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.224675:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902342 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d6f expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.224696:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a1902342 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d6f expref: 21 pid: 5823 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.224713:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed291bd5700) 00010000:00010000:3.0:1787604003.224720:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.224729:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.224737:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.224764:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787604003.224802:0:7875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.224810:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787604003.225019:0:7875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000100:00100000:3.0:1787604003.225023:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:2364:x1874438345817088:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 385us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604003.225030:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 84 00000001:00080000:2.0:1787604003.225184:0:7875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787604003.225233:0:7875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787604003.225315:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7875:1874438355235328:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787604003.225383:0:7875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604003.225419:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28639da80 going to sleep for 11 seconds 00000100:00100000:3.0:1787604003.225674:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355235328 00000100:00100000:3.0:1787604003.225680:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355235328 00000100:00100000:3.0:1787604003.225719:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787604003.225728:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7875:x1874438355235328:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787604003.226256:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7875:x1874438355235328:12345-0@lo:1000:mdt00_003.0 Request processed in 528us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604003.226273:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787604003.226634:0:7875:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1787604003.226641:0:7875:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1787604003.226659:0:7875:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2c1ec4000, transno 4294967321 00000100:00100000:1.0:1787604003.226683:0:7875:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed2c1ec5880 x1874438355234432/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787604019 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604003.226696:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7875:1874438355235328:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787604003.228011:0:7875:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787604003.228094:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b613bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7875:1874438355235456:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787604003.228148:0:7875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604003.228182:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295245b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787604003.228508:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355235456 00000100:00100000:2.0:1787604003.228517:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355235456 00000100:00100000:2.0:1787604003.228576:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787604003.228586:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7875:x1874438355235456:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787604003.228769:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7875:x1874438355235456:12345-0@lo:1000:mdt00_003.0 Request processed in 185us (620us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787604003.228777:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787604003.229006:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b613bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7875:1874438355235456:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787604003.229042:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229053:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229074:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229080:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962a00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604003.229084:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229092:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229108:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed291bd5700) 00010000:00010000:0.0:1787604003.229111:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787604003.229116:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229123:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962a00/0xb5d1f3b1a190238f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229158:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a19022d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229165:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a19022d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229171:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a19022d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229176:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604003.229179:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a19022d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229388:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a19022d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229400:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:0.0:1787604003.229402:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787604003.229410:0:7875:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19022d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d53 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229421:0:7875:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19022d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d53 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229430:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19022d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d53 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.229540:0:7875:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19022d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d53 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604003.229555:0:7875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf472680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355235584:192.168.202.21@tcp:105: 00000100:00100000:0.0:1787604003.229635:0:7875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295142180 going to sleep for 11 seconds 00000100:00100000:0.0:1787604003.232623:0:7875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf472680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7875:1874438355235584:192.168.202.21@tcp:105: 00010000:00010000:0.0:1787604003.232656:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a19022d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.232668:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962400/0xb5d1f3b1a19022d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.232700:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1902396 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.232728:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1902396 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.232740:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1902396 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.232751:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1902396 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.232758:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1902396 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.232764:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1902396 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.232770:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604003.232774:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1902396 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.232781:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1902396 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.232792:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:0.0:1787604003.232805:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604003.232810:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1902396 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.232815:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595200/0xb5d1f3b1a1902396 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.232825:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902388 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.233058:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902388 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.233067:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902388 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.233072:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963c00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604003.233075:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902388 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.233082:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902388 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.233091:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:0.0:1787604003.233093:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787604003.233097:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902388 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604003.233103:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902388 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604003.233760:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bed4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+23:11613:x1874438345816960:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 14272us (14479us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1787604003.233772:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 230 00000020:00080000:0.0:1787604003.233780:0:7875:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787604003.234653:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787604003.234664:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787604003.235668:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787604003.235684:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787604003.237738:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604003.237916:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604003.238587:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345817472 00000100:00100000:3.0:1787604003.238599:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345817472 00000100:00100000:0.0:1787604003.238993:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345817216 00000100:00100000:0.0:1787604003.238999:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345817216 00000100:00100000:0.0:1787604003.239017:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 61 00000100:00100000:0.0:1787604003.239027:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:11613:x1874438345817472:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787604003.239286:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 62 00000100:00100000:1.0:1787604003.239296:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed291f92850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:11612:x1874438345817216:12345-192.168.202.21@tcp:49:lfs.0 00000100:00100000:1.0:1787604003.239416:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed291f92850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+24:11612:x1874438345817216:12345-192.168.202.21@tcp:49:lfs.0 Request processed in 122us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604003.239424:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 62 00000004:00080000:1.0:1787604003.242104:0:5824:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787604003.242433:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787604003.242570:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190239d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.242588:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190239d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.242599:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190239d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.242608:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190239d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.242614:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190239d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.242621:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190239d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604003.242720:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787604003.242875:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+25:11613:x1874438345817472:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 3810us (5106us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787604003.242885:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 61 00000020:00080000:1.0:1787604003.242891:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787604003.243792:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604003.243932:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190239d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.243944:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e400 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604003.243949:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190239d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.243958:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190239d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.243973:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ed291bd5300) 00010000:00010000:2.0:1787604003.243977:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787604003.243981:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190239d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.243988:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190239d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.244006:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604003.244007:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604003.244009:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604003.250434:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604003.250633:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345817728 00000100:00100000:0.0:1787604003.250644:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345817728 00000100:00100000:0.0:1787604003.250752:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 231 00000100:00100000:0.0:1787604003.250763:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+25:11612:x1874438345817728:12345-192.168.202.21@tcp:58:lfs.0 00000040:00080000:0.0:1787604003.251067:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787604003.251162:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+25:11612:x1874438345817728:12345-192.168.202.21@tcp:58:lfs.0 Request processed in 400us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604003.251171:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 231 00000100:00100000:0.0:1787604003.297675:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604003.298057:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345817856 00000100:00100000:3.0:1787604003.298068:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345817856 00000100:00100000:3.0:1787604003.298129:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 232 00000100:00100000:3.0:1787604003.298140:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+25:11615:x1874438345817856:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:3.0:1787604003.298169:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604003.298204:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19023a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d8b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.298292:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19023ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.298319:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19023ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.298331:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19023ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.298367:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19023b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.298375:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19023b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.298382:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19023b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.300440:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19023b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.300483:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d4c expref: 26 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.300492:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19023b9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.300537:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d4c expref: 26 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.300558:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d4c expref: 26 pid: 7875 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604003.300573:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf414a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1874438355235712:192.168.202.21@tcp:104: 00000100:00100000:3.0:1787604003.301770:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28670a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787604003.312298:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf414a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1874438355235712:192.168.202.21@tcp:104: 00010000:00010000:3.0:1787604003.312332:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19023b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604003.317450:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604003.318053:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345818112 00000100:00100000:1.0:1787604003.318067:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345818112 00000100:00100000:1.0:1787604003.318164:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 63 00000100:00100000:1.0:1787604003.318177:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+27:5605:x1874438345818112:12345-192.168.202.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787604003.318752:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+28:5605:x1874438345818112:12345-192.168.202.21@tcp:35:ldlm_bl.0 Request processed in 576us (1313us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787604003.318760:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 63 00000100:00100000:1.0:1787604003.326243:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604003.326615:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345818240 00000100:00100000:2.0:1787604003.326625:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345818240 00010000:00010000:2.0:1787604003.326684:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d4c expref: 28 pid: 7875 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604003.329073:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 85 00000100:00100000:2.0:1787604003.329102:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+28:2364:x1874438345818240:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787604003.329123:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604003.329136:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d4c expref: 28 pid: 7875 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.329152:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d4c expref: 28 pid: 7875 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.329175:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a19022c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d4c expref: 28 pid: 7875 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.329201:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:2.0:1787604003.329208:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19023b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.329217:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19023b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.329223:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19023b9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604003.329254:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787604003.331601:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19023b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331618:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19023b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604003.331668:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787604003.331673:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787604003.331695:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19023b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331710:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19023b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331720:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19023ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331726:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19023ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331733:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19023ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331740:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604003.331744:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19023ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331751:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19023ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331766:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:3.0:1787604003.331787:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604003.331792:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19023ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331809:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac800/0xb5d1f3b1a19023ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331827:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19023b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331833:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19023b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331883:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19023b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331889:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604003.331892:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19023b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331898:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19023b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331915:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ed290d35d00) 00010000:00010000:3.0:1787604003.331918:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604003.331922:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19023b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331928:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19023b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.331972:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19023a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d8b expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.332001:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19023b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d8b expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604003.332018:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:3.0:1787604003.332021:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787604003.332024:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad200, rc 0) 00000100:00100000:3.0:1787604003.332091:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+27:11615:x1874438345817856:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 33951us (34426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604003.332100:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 232 00000100:00100000:2.0:1787604003.334432:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:2364:x1874438345818240:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 5334us (8187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604003.334447:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 85 00000100:00100000:3.0:1787604003.799413:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355236224:0@lo:400:kworker.0 00000100:00100000:2.0:1787604003.799493:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355235840:0@lo:400:kworker.0 00000100:00100000:3.0:1787604003.799525:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604003.799529:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604003.799588:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787604003.799595:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355235968:0@lo:400:kworker.0 00000100:00100000:2.0:1787604003.799620:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604003.799650:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355236096:0@lo:400:kworker.0 00000100:00100000:2.0:1787604003.799673:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604003.799706:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355236224 00000100:00100000:2.0:1787604003.799714:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355236224 00000100:00100000:2.0:1787604003.799772:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355235968 00000100:00100000:2.0:1787604003.799775:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355235968 00000100:00100000:2.0:1787604003.799786:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355236096 00000100:00100000:2.0:1787604003.799789:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355236096 00000100:00100000:2.0:1787604003.799804:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787604003.799812:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355236224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604003.799878:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355236224:12345-0@lo:400:kworker.0 Request processed in 66us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604003.799885:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787604003.799901:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787604003.799906:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355235968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604003.799934:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355235968:12345-0@lo:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604003.799939:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787604003.799950:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787604003.799956:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355236096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604003.799982:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355236096:12345-0@lo:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604003.799994:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1787604003.800009:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787604003.800038:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355236096:0@lo:400:kworker.0 00000100:00100000:2.0:1787604003.800064:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355235968:0@lo:400:kworker.0 00000100:00100000:1.0:1787604003.800343:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355235840 00000100:00100000:1.0:1787604003.800349:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355235840 00000100:00100000:1.0:1787604003.800380:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787604003.800387:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355235840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604003.800430:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3283:x1874438355235840:12345-0@lo:400:kworker.0 Request processed in 43us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604003.800436:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787604003.800495:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355235840:0@lo:400:kworker.0 00000100:00100000:1.0:1787604003.801894:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787604003.801914:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355236352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787604003.801966:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604003.802017:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355236352 00000100:00100000:1.0:1787604003.802024:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355236352 00000100:00100000:1.0:1787604003.802065:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787604003.802076:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355236352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787604003.802095:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604003.802135:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355236352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604003.802141:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787604003.802197:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355236352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787604003.805679:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355236224:0@lo:400:kworker.0 00000040:00080000:1.0:1787604004.026360:0:12493:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787604004.026373:0:12493:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787604004.026433:0:12493:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787604004.026441:0:12493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787604004.247522:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787604004.247530:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787604004.247567:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787604004.247576:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787604004.247705:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed290176d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874438355236480:192.168.202.21@tcp:107:hsm_cdtr.0 00010000:00010000:2.0:1787604004.247762:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604004.247805:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2984fd000 going to sleep for 11 seconds 00000100:00100000:2.0:1787604004.250928:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed290176d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874438355236480:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787604004.251352:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604004.251986:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345818368 00000100:00100000:2.0:1787604004.251999:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345818368 00000100:00100000:2.0:1787604004.252068:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 233 00000100:00100000:2.0:1787604004.252078:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:11628:x1874438345818368:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787604004.252114:0:7875:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787604004.252240:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:11628:x1874438345818368:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 Request processed in 162us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604004.252249:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 233 00000100:00100000:1.0:1787604004.262151:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604004.262187:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345818624 00000100:00100000:1.0:1787604004.262260:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345818624 00000100:00100000:1.0:1787604004.262313:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 234 00000100:00100000:1.0:1787604004.262322:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+26:11628:x1874438345818624:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787604004.262341:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604004.262360:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a19023c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d92 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604004.262469:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a19023c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604004.262484:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a19023c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604004.262494:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a19023c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604004.262512:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787604004.262700:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f600/0xb5d1f3b1a19023c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d92 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604004.262716:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a19023c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d92 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604004.262725:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:1.0:1787604004.262728:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787604004.262732:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f000, rc 0) 00000100:00100000:1.0:1787604004.262785:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+28:11628:x1874438345818624:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 463us (643us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787604004.262793:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 234 00000100:00100000:2.0:1787604004.272471:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604004.272606:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345818880 00000100:00100000:0.0:1787604004.272616:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345818880 00000100:00100000:0.0:1787604004.272680:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 235 00000100:00100000:0.0:1787604004.272690:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+28:11628:x1874438345818880:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787604004.272773:0:7875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19023d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604004.272792:0:7875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19023d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604004.272803:0:7875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19023d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604004.273162:0:7875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19023d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604004.273170:0:7875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19023d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604004.273177:0:7875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19023d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604004.273590:0:7875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604004.273596:0:7875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19023d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604004.273604:0:7875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19023d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604004.273620:0:7875:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:0.0:1787604004.273623:0:7875:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787604004.273629:0:7875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19023d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604004.273636:0:7875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595800/0xb5d1f3b1a19023d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604004.273895:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:11628:x1874438345818880:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 1203us (1442us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787604004.273913:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 235 00000040:00080000:2.0:1787604004.273965:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787604004.273970:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787604004.274468:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787604004.274477:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787604004.281744:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604004.288051:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604004.288107:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345819264 00000100:00100000:3.0:1787604004.288118:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345819264 00000100:00100000:3.0:1787604004.288234:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 64 00000100:00100000:3.0:1787604004.288246:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:11628:x1874438345819264:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787604004.288389:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345819008 00000100:00100000:2.0:1787604004.288394:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345819008 00000100:00100000:2.0:1787604004.288493:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 18 00000100:00100000:3.0:1787604004.288500:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:11628:x1874438345819264:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 257us (462us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787604004.288501:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2989fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:2363:x1874438345819008:12345-192.168.202.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787604004.288508:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 64 00010000:00010000:2.0:1787604004.288511:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604004.288533:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a19023c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d92 expref: 30 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604004.288565:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:2.0:1787604004.288571:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604004.288592:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2989fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:2363:x1874438345819008:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 92us (6858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604004.288598:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 18 00000100:00100000:1.0:1787604004.311287:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355236608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787604004.311373:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604004.311465:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355236608 00000100:00100000:3.0:1787604004.311474:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355236608 00000100:00100000:3.0:1787604004.311537:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787604004.311547:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355236608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787604004.311583:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787604004.311638:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355236608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604004.311646:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787604004.311725:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355236608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787604005.271404:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787604006.188425:0:12544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787604006.188449:0:12544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787604006.188517:0:12544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787604006.188524:0:12544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787604006.298761:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604006.454583:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604006.454825:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345819520 00000100:00100000:2.0:1787604006.454864:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345819520 00000100:00080000:3.0:1787604006.454966:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787604006.454975:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 236 00000100:00100000:2.0:1787604006.454991:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+29:11648:x1874438345819520:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:2.0:1787604006.455031:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604006.455063:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a19023dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5d99 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604006.455211:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a19023e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604006.455228:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a19023e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604006.455243:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a19023e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604006.455256:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787604006.455420:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962600/0xb5d1f3b1a19023dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d99 expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604006.455452:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a19023e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d99 expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604006.455469:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:2.0:1787604006.455473:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787604006.455478:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962000, rc 0) 00000100:00100000:2.0:1787604006.455562:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:11648:x1874438345819520:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 576us (996us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787604006.455571:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 236 00000100:00100000:2.0:1787604006.475496:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604006.475547:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345819648 00000100:00100000:3.0:1787604006.475562:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345819648 00000100:00100000:3.0:1787604006.475646:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 237 00000100:00100000:3.0:1787604006.475660:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:11648:x1874438345819648:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:3.0:1787604006.475784:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19023f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604006.475810:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19023f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604006.475824:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19023f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604006.475877:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19023f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604006.475885:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19023f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604006.475892:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19023f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604006.475904:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604006.475909:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19023f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604006.475917:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19023f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604006.475932:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:3.0:1787604006.475935:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787604006.475941:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19023f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604006.475946:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a19023f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604006.476031:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:11648:x1874438345819648:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 373us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604006.476039:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 237 00000100:00100000:3.0:1787604006.593144:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604006.593610:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345819776 00000100:00100000:0.0:1787604006.593627:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345819776 00000100:00080000:3.0:1787604006.593697:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787604006.593732:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 71 00000100:00100000:0.0:1787604006.593747:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2363:x1874438345819776:12345-192.168.202.21@tcp:101:cat.0 00010000:00010000:0.0:1787604006.593772:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604006.593803:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19023f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5da0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787604006.593876:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8cac22, atime: 0x6a8cac21, ctime: 0x6a8cac22, blocks: 0xb 00010000:00010000:0.0:1787604006.593904:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1787604006.593909:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604006.593922:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19023f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5da0 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604006.593946:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19023f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5da0 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604006.593963:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594000, rc 0) 00000100:00100000:2.0:1787604006.595169:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2363:x1874438345819776:12345-192.168.202.21@tcp:101:cat.0 Request processed in 1404us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604006.595182:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 71 00000100:00100000:3.0:1787604006.597744:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604006.597821:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345819904 00000100:00100000:1.0:1787604006.597834:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345819904 00002000:00100000:2.0:1787604006.598528:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9ed2bf6d9c00 x1874438345819904/t0(0) o3->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:332/0 lens 488/0 e 0 to 0 dl 1787604017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787604006.598540:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2bf6d9c00 with x1874438345819904 ext(0->4095) 00002000:00010000:2.0:1787604006.598546:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2bf6d9c00 00000100:00100000:2.0:1787604006.598580:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:2.0:1787604006.598589:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2365:x1874438345819904:12345-192.168.202.21@tcp:3:cat.0 00000100:00100000:2.0:1787604006.598824:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2365:x1874438345819904:12345-192.168.202.21@tcp:3:cat.0 Request processed in 234us (1090us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787604006.598832:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 7 00002000:00100000:2.0:1787604006.598880:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9ed2bf6d9c00 x1874438345819904/t0(0) o3->a45d6158-dc8e-48e6-b534-483bf3fa20ad@192.168.202.21@tcp:332/0 lens 488/4536 e 0 to 0 dl 1787604017 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787604006.598889:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2bf6d9c00 with x1874438345819904 ext(0->4095) 00002000:00010000:2.0:1787604006.598892:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2bf6d9c00 00000100:00100000:0.0:1787604006.697270:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604006.697514:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604006.697565:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604006.697596:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604006.697629:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604006.697672:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345820544 00000100:00100000:0.0:1787604006.697686:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345820544 00000100:00100000:0.0:1787604006.697764:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345820160 00000100:00100000:0.0:1787604006.697767:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345820160 00000100:00100000:0.0:1787604006.697819:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 160 00000100:00100000:0.0:1787604006.697833:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2364:x1874438345820544:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787604006.698396:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 161 00000100:00100000:3.0:1787604006.698412:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:2364:x1874438345820160:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787604006.698646:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+31:2364:x1874438345820160:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 239us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604006.698656:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 161 00000100:00080000:3.0:1787604006.698688:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787604006.699037:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345820288 00000100:00100000:2.0:1787604006.699045:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345820288 00000100:00100000:2.0:1787604006.699119:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345820416 00000100:00100000:2.0:1787604006.699123:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345820416 00000100:00100000:2.0:1787604006.699148:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 73 00000100:00100000:2.0:1787604006.699157:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2364:x1874438345820288:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787604006.699202:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2364:x1874438345820288:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 47us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604006.699210:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 73 00000100:00100000:2.0:1787604006.699230:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 74 00000100:00100000:2.0:1787604006.699238:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2364:x1874438345820416:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787604006.699342:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+8:2364:x1874438345820416:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 33us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604006.699350:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 74 00000100:00100000:0.0:1787604006.699789:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2364:x1874438345820544:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 1960us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604006.699797:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 160 00000100:00080000:3.0:1787604006.700177:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787604006.703608:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345820032 00000100:00100000:1.0:1787604006.703631:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345820032 00000100:00100000:1.0:1787604006.703730:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 299 00000100:00100000:1.0:1787604006.703744:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2364:x1874438345820032:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604006.703922:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2364:x1874438345820032:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 179us (6669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604006.703931:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 299 00000001:00080000:1.0:1787604006.990706:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1787604006.990728:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:2.0:1787604007.320164:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604008.343125:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787604008.483387:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1787604008.483413:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1787604008.529002:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:2.0:1787604008.529049:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed284e31840 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787604008.529056:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed2b4e33400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed284e31540 00000020:00080000:2.0:1787604008.529060:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ed2b4e33d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2864a3400 00000001:00080000:2.0:1787604008.529079:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1787604008.529096:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1787604008.529258:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787604008.529652:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1787604008.920278:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355236736:0@lo:400:kworker.0 00000100:00100000:3.0:1787604008.920389:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604008.920459:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355237248:0@lo:400:kworker.0 00000100:00100000:3.0:1787604008.920492:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604008.920523:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787604008.920529:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355236864:0@lo:400:kworker.0 00000100:00100000:3.0:1787604008.920551:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604008.920570:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355237376:0@lo:400:kworker.0 00000100:00100000:3.0:1787604008.920599:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604008.920634:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355236992:0@lo:400:kworker.0 00000100:00100000:3.0:1787604008.920675:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604008.920696:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787604008.920701:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355237120:0@lo:400:kworker.0 00000100:00100000:3.0:1787604008.920737:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604008.920781:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355236736 00000100:00100000:3.0:1787604008.920791:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355236736 00000100:00100000:3.0:1787604008.920887:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787604008.920898:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355236736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604008.920967:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355236736:12345-0@lo:400:kworker.0 Request processed in 59us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604008.920975:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787604008.921017:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355237248 00000100:00100000:3.0:1787604008.922595:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355237248 00000100:00100000:3.0:1787604008.926561:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355236864 00000100:00100000:3.0:1787604008.926580:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355236864 00000100:00100000:3.0:1787604008.926602:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355236992 00000100:00100000:3.0:1787604008.926606:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355236992 00000100:00100000:0.0:1787604008.926909:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787604008.926923:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355237248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604008.927035:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355237248:12345-0@lo:400:kworker.0 Request processed in 115us (6541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604008.927043:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787604008.927066:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787604008.927074:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355236864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604008.927103:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355236864:12345-0@lo:400:kworker.0 Request processed in 31us (6551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604008.927109:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787604008.927128:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787604008.927160:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355237504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787604008.927207:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604008.927253:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355237504 00000100:00100000:0.0:1787604008.927258:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355237504 00000100:00080000:2.0:1787604008.927731:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787604008.927739:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787604008.928222:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355237376 00000100:00100000:2.0:1787604008.928233:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355237376 00000100:00100000:2.0:1787604008.928301:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355237120 00000100:00100000:2.0:1787604008.928305:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355237120 00000100:00100000:2.0:1787604008.928350:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787604008.928360:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355237376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604008.928455:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355237376:12345-0@lo:400:kworker.0 Request processed in 96us (7853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604008.928463:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787604008.928667:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787604008.928674:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1874438355237120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604008.928708:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1874438355237120:12345-0@lo:400:kworker.0 Request processed in 35us (7981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604008.928714:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1787604008.929942:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787604008.931948:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787604008.932158:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355236992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604008.932280:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355236992:12345-0@lo:400:kworker.0 Request processed in 141us (11603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604008.932288:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787604008.932572:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355236864:0@lo:400:kworker.0 00000100:00100000:3.0:1787604008.932588:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787604008.932594:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2c1ec5880, transno 4294967322 00000004:00080000:3.0:1787604008.932608:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787604008.932637:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355237376:0@lo:400:kworker.0 00000100:00100000:3.0:1787604008.932652:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355236736:0@lo:400:kworker.0 00000100:00100000:3.0:1787604008.932665:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355237248:0@lo:400:kworker.0 00000100:00100000:2.0:1787604008.935288:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787604008.935305:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1787604008.935331:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2b6138380, transno 4294967310 00000100:00100000:2.0:1787604008.935365:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355237120:0@lo:400:kworker.0 00000100:00100000:2.0:1787604008.935385:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355236992:0@lo:400:kworker.0 00000100:00100000:0.0:1787604008.937427:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787604008.937447:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355237504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787604008.937498:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787604008.937614:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355237504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (10407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604008.937623:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787604008.937690:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355237504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787604009.376030:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604009.432143:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355237632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787604009.432245:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604009.432495:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355237632 00000100:00100000:3.0:1787604009.432506:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355237632 00000100:00100000:3.0:1787604009.432570:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787604009.432582:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355237632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787604009.432626:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604009.432709:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355237632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604009.432718:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787604009.432819:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355237632:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787604010.391396:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604011.329175:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604011.329301:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345820672 00000100:00100000:2.0:1787604011.329315:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345820672 00000100:00100000:2.0:1787604011.329416:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 238 00000100:00100000:2.0:1787604011.329430:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:11293:x1874438345820672:12345-192.168.202.21@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787604011.329568:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:11293:x1874438345820672:12345-192.168.202.21@tcp:60:lhsmtool_posix.0 Request processed in 141us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604011.329598:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 238 00000100:00080000:3.0:1787604011.333516:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787604011.336053:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604011.336402:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345820928 00000100:00100000:1.0:1787604011.336416:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345820928 00000100:00100000:1.0:1787604011.336480:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 65 00000100:00100000:1.0:1787604011.336492:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:11293:x1874438345820928:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787604011.337419:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:11293:x1874438345820928:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 922us (1369us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787604011.337431:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 65 00010000:00010000:0.0:1787604011.416558:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604011.600182:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604011.600301:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345821056 00000100:00100000:3.0:1787604011.600315:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345821056 00000100:00100000:3.0:1787604011.600460:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 239 00000100:00100000:3.0:1787604011.600473:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:12102:x1874438345821056:12345-192.168.202.21@tcp:101:lsof.0 00010000:00010000:3.0:1787604011.600500:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604011.600527:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19023ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5da7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604011.600614:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902406 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604011.600632:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902406 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604011.600646:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902406 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604011.600948:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787604011.600953:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787604011.601042:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902406 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604011.601074:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac000/0xb5d1f3b1a19023ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5da7 expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604011.601096:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902406 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5da7 expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604011.601106:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b900) 00010000:00010000:3.0:1787604011.601110:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787604011.601114:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac200, rc 0) 00000100:00100000:3.0:1787604011.601218:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:12102:x1874438345821056:12345-192.168.202.21@tcp:101:lsof.0 Request processed in 747us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604011.601233:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 239 00000100:00080000:2.0:1787604011.601967:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787604011.816404:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604011.816458:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604011.816499:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604011.816533:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604011.816573:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345821696 00000100:00100000:2.0:1787604011.816586:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345821696 00000100:00100000:2.0:1787604011.816645:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345821312 00000100:00100000:2.0:1787604011.816649:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345821312 00000100:00100000:2.0:1787604011.816673:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 165 00000100:00100000:2.0:1787604011.816685:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:2365:x1874438345821696:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787604011.816783:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:2365:x1874438345821696:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 99us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604011.816792:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 165 00000100:00100000:2.0:1787604011.816812:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 166 00000100:00100000:2.0:1787604011.816820:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:2365:x1874438345821312:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787604011.816898:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:2365:x1874438345821312:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 79us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604011.816905:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 166 00000100:00100000:2.0:1787604011.816950:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604011.817094:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345821440 00000100:00100000:2.0:1787604011.817099:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345821440 00000100:00100000:2.0:1787604011.817146:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345821568 00000100:00100000:2.0:1787604011.817150:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345821568 00000100:00100000:2.0:1787604011.817190:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 77 00000100:00100000:2.0:1787604011.817197:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2365:x1874438345821440:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787604011.817229:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2365:x1874438345821440:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 32us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604011.817236:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 77 00000100:00100000:2.0:1787604011.817247:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 78 00000100:00100000:2.0:1787604011.817253:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2365:x1874438345821568:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787604011.817275:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2365:x1874438345821568:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 22us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604011.817281:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 78 00000100:00080000:2.0:1787604011.817301:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787604011.817305:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787604011.817681:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345821184 00000100:00100000:1.0:1787604011.817686:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345821184 00000100:00100000:1.0:1787604011.817732:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 301 00000100:00100000:1.0:1787604011.817740:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345821184:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604011.817783:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2365:x1874438345821184:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 45us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604011.817791:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 301 00010000:00010000:2.0:1787604012.441282:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787604012.503272:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787604012.503286:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787604012.503682:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787604012.503691:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787604013.463065:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787604013.607217:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787604013.607229:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787604013.607288:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787604013.607299:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1787604014.039940:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787604014.039966:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355237760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787604014.040040:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604014.040217:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355237760 00000100:00100000:2.0:1787604014.040227:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355237760 00000100:00100000:2.0:1787604014.040307:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787604014.040317:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355237760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787604014.040355:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604014.040415:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355237760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604014.040422:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787604014.041395:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355238016:0@lo:400:kworker.0 00000100:00100000:2.0:1787604014.041444:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604014.041490:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787604014.041497:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355238144:0@lo:400:kworker.0 00000100:00100000:2.0:1787604014.041521:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604014.041557:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355238016 00000100:00100000:2.0:1787604014.041563:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355238016 00000100:00100000:2.0:1787604014.041596:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355238144 00000100:00100000:2.0:1787604014.041599:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355238144 00000100:00100000:2.0:1787604014.041622:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787604014.041630:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355238016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604014.041672:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355238016:12345-0@lo:400:kworker.0 Request processed in 43us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604014.041679:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787604014.041693:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787604014.041715:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355238144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604014.041747:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355238144:12345-0@lo:400:kworker.0 Request processed in 48us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604014.041754:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787604014.041788:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355238144:0@lo:400:kworker.0 00000100:00100000:2.0:1787604014.041801:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355238016:0@lo:400:kworker.0 00000100:00100000:3.0:1787604014.042079:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355238272:0@lo:400:kworker.0 00000100:00100000:3.0:1787604014.042114:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604014.042145:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787604014.042151:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355237888:0@lo:400:kworker.0 00000100:00100000:3.0:1787604014.042178:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604014.042199:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355238400:0@lo:400:kworker.0 00000100:00100000:3.0:1787604014.042225:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604014.042252:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355238272 00000100:00100000:3.0:1787604014.042256:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355238272 00000100:00100000:3.0:1787604014.042280:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787604014.042288:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355238272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604014.042323:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874438355238272:12345-0@lo:400:kworker.0 Request processed in 36us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604014.042329:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787604014.042350:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355237888 00000100:00100000:3.0:1787604014.042353:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355237888 00000100:00100000:3.0:1787604014.042394:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787604014.042401:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355237888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604014.042430:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3281:x1874438355237888:12345-0@lo:400:kworker.0 Request processed in 30us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604014.042436:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787604014.042463:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355238400 00000100:00100000:3.0:1787604014.042466:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355238400 00000100:00100000:3.0:1787604014.042496:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787604014.042502:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355238400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604014.042542:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355238400:12345-0@lo:400:kworker.0 Request processed in 40us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604014.042549:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787604014.042581:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355237888:0@lo:400:kworker.0 00000100:00100000:3.0:1787604014.042591:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355238400:0@lo:400:kworker.0 00000100:00100000:3.0:1787604014.042600:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3281:1874438355238272:0@lo:400:kworker.0 00000100:00080000:0.0:1787604014.043102:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787604014.043108:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787604014.043110:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787604014.043153:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355237760:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787604014.391032:0:12749:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:40:12 (1787604012) 00010000:00010000:1.0:1787604014.489323:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604014.556252:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355238528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787604014.556326:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604014.565434:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355238528 00000100:00100000:2.0:1787604014.565451:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355238528 00000100:00100000:2.0:1787604014.565503:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787604014.565514:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355238528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787604014.565556:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604014.570890:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355238528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5366us (14552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604014.570916:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787604014.579304:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355238528:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787604015.514681:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604016.535227:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604016.938032:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604016.938106:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604016.938159:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604016.938185:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604016.938209:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604016.938242:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345822080 00000100:00100000:0.0:1787604016.938253:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345822080 00000100:00100000:1.0:1787604016.938256:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345822208 00000100:00100000:1.0:1787604016.938263:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345822208 00000100:00100000:0.0:1787604016.938324:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 80 00000100:00100000:0.0:1787604016.938334:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345822080:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787604016.938447:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2366:x1874438345822080:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 114us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604016.938455:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 80 00000100:00100000:0.0:1787604016.938472:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 81 00000100:00100000:0.0:1787604016.938479:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2366:x1874438345822208:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787604016.938504:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2366:x1874438345822208:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604016.938511:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 81 00000100:00100000:3.0:1787604016.938767:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345822336 00000100:00100000:3.0:1787604016.938772:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345822336 00000100:00100000:3.0:1787604016.938803:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345821952 00000100:00100000:3.0:1787604016.938807:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345821952 00000100:00100000:3.0:1787604016.938829:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 170 00000100:00100000:3.0:1787604016.938865:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:2366:x1874438345822336:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787604016.938900:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:2366:x1874438345822336:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 65us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604016.938906:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 170 00000100:00100000:3.0:1787604016.938920:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 171 00000100:00100000:3.0:1787604016.938927:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:2366:x1874438345821952:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:3.0:1787604016.938952:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:2366:x1874438345821952:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 26us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604016.938958:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 171 00000100:00100000:2.0:1787604016.939167:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345821824 00000100:00100000:2.0:1787604016.939172:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345821824 00000100:00100000:2.0:1787604016.939204:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 303 00000100:00100000:2.0:1787604016.939210:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2366:x1874438345821824:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787604016.939243:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2366:x1874438345821824:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 33us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604016.939249:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 303 00000100:00080000:2.0:1787604016.939290:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787604016.939295:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787604016.939298:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787604017.559186:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604018.544877:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604018.544985:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345822592 00000100:00100000:3.0:1787604018.544999:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345822592 00000100:00100000:3.0:1787604018.545101:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 66 00000100:00100000:3.0:1787604018.545116:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+18:12324:x1874438345822592:12345-192.168.202.21@tcp:35:umount.0 00000100:00100000:3.0:1787604018.546628:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:12324:x1874438345822592:12345-192.168.202.21@tcp:35:umount.0 Request processed in 1505us (1855us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787604018.546643:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 66 00000100:00080000:2.0:1787604018.546787:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787604018.552998:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604018.553986:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345822848 00000100:00100000:0.0:1787604018.554007:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345822848 00000100:00100000:0.0:1787604018.554103:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 67 00000100:00100000:0.0:1787604018.554116:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+19:12324:x1874438345822848:12345-192.168.202.21@tcp:35:umount.0 00000100:00100000:0.0:1787604018.556152:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:12324:x1874438345822848:12345-192.168.202.21@tcp:35:umount.0 Request processed in 2017us (3148us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787604018.556173:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 67 00000100:00100000:0.0:1787604018.574978:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604018.575227:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345823104 00000100:00100000:1.0:1787604018.575244:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345823104 00000100:00100000:1.0:1787604018.575323:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 68 00000100:00100000:1.0:1787604018.575345:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed291f90850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+20:12324:x1874438345823104:12345-192.168.202.21@tcp:35:umount.0 00000100:00100000:1.0:1787604018.575984:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed291f90850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:12324:x1874438345823104:12345-192.168.202.21@tcp:35:umount.0 Request processed in 639us (1019us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787604018.575994:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 68 00000100:00100000:2.0:1787604018.581799:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604018.581917:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345823360 00000100:00100000:0.0:1787604018.581930:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345823360 00000100:00100000:0.0:1787604018.582010:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 69 00000100:00100000:0.0:1787604018.582024:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+21:12324:x1874438345823360:12345-192.168.202.21@tcp:35:umount.0 00000100:00100000:0.0:1787604018.582530:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:12324:x1874438345823360:12345-192.168.202.21@tcp:35:umount.0 Request processed in 507us (743us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787604018.582540:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 69 00010000:00010000:2.0:1787604018.583268:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604018.596527:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604018.596593:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604018.596688:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345823488 00000100:00100000:1.0:1787604018.596702:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345823488 00000100:00100000:1.0:1787604018.596980:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345823616 00000100:00100000:1.0:1787604018.596985:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345823616 00000100:00100000:1.0:1787604018.597019:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:1.0:1787604018.597033:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f844a97d-1878-4049-bbc8-d860aeb2443e+14:2363:x1874438345823488:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604018.597068:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604018.597098:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5dace00/0xb5d1f3b1a190141c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5932 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604018.597120:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604018.597344:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00100000:2.0:1787604018.597357:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+13:2363:x1874438345823616:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787604018.597367:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604018.597378:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2813a0800/0xb5d1f3b1a19013e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e58fa expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.597390:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604018.597458:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+12:2363:x1874438345823616:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 104us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604018.597486:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00100000:1.0:1787604018.597705:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f844a97d-1878-4049-bbc8-d860aeb2443e+11:2363:x1874438345823488:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 674us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604018.597713:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:2.0:1787604018.599570:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604018.599640:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345823744 00000100:00100000:3.0:1787604018.599650:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345823744 00000100:00100000:3.0:1787604018.599719:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 21 00000100:00100000:3.0:1787604018.599731:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba159c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+11:2364:x1874438345823744:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787604018.599746:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604018.599781:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed298595a00/0xb5d1f3b1a1901692 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59fd expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604018.599801:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787604018.599885:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba159c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2364:x1874438345823744:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 156us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604018.599893:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 21 00000100:00100000:2.0:1787604018.605792:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604018.605950:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345824128 00000100:00100000:3.0:1787604018.605964:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345824128 00000100:00100000:3.0:1787604018.606072:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 72 00000100:00100000:3.0:1787604018.606086:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2362:x1874438345824128:12345-192.168.202.21@tcp:9:umount.0 00000020:00000080:3.0:1787604018.606140:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19019b7 00000020:00010000:3.0:1787604018.606151:0:6678:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ed2863f6800: total 0 00000100:00080000:3.0:1787604018.606156:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9ed2863f3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787604018.606210:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787604018.606573:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2362:x1874438345824128:12345-192.168.202.21@tcp:9:umount.0 Request processed in 489us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604018.606582:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 72 00000020:00010000:2.0:1787604018.607236:0:6692:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ed2863f6800: total 0 00010000:00010000:2.0:1787604018.607284:0:6692:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ed2863f6800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787604018.607366:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1901d5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bd2 expref: 4 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.607408:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19023f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5da0 expref: 3 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.607427:0:6692:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ed2863f6800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787604018.607439:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604018.607441:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604018.607443:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787604018.607454:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787604018.616647:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604018.617392:0:10671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345824256 00000100:00100000:3.0:1787604018.617409:0:10671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345824256 00000100:00100000:3.0:1787604018.617521:0:10671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 73 00000100:00100000:3.0:1787604018.617535:0:10671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+5:2362:x1874438345824256:12345-192.168.202.21@tcp:9:umount.0 00000020:00000080:3.0:1787604018.617579:0:10671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901756 00000100:00080000:3.0:1787604018.617590:0:10671:0:(import.c:65:import_set_state_nolock()) ffff9ed2863f3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787604018.617654:0:10671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:2.0:1787604018.617939:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787604018.618003:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604018.619506:0:10671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a45d6158-dc8e-48e6-b534-483bf3fa20ad+2:2362:x1874438345824256:12345-192.168.202.21@tcp:9:umount.0 Request processed in 1962us (2863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604018.619521:0:10671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 73 00000100:00100000:2.0:1787604018.629702:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604018.634865:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345825280 00000100:00100000:3.0:1787604018.634891:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345825280 00000100:00100000:3.0:1787604018.634983:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 240 00000100:00100000:3.0:1787604018.634996:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+22:2362:x1874438345825280:12345-192.168.202.21@tcp:39:umount.0 00000020:00000080:3.0:1787604018.635043:0:5821:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19013f2 00000020:00010000:3.0:1787604018.635081:0:5821:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ed285c15800: total 0 00000100:00080000:3.0:1787604018.635088:0:5821:0:(import.c:65:import_set_state_nolock()) ffff9ed1835b9000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1787604018.635489:0:5810:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ed285c15800: total 0 00010000:00010000:2.0:1787604018.635556:0:5810:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ed285c15800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787604018.635597:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:2.0:1787604018.635601:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787604018.635610:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dacc00/0xb5d1f3b1a190172c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a27 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.635637:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:2.0:1787604018.635658:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787604018.635664:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a19022d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d53 expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.635681:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:2.0:1787604018.635684:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787604018.635688:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594600/0xb5d1f3b1a1901dd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bf5 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.635700:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:2.0:1787604018.635703:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787604018.635707:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ee00/0xb5d1f3b1a1901c3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5b85 expref: 18 pid: 7875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.635720:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b900) 00010000:00010000:2.0:1787604018.635723:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787604018.635726:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594a00/0xb5d1f3b1a1901dbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bee expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.635738:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed290d35200) 00010000:00010000:2.0:1787604018.635740:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604018.635744:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad800/0xb5d1f3b1a19016d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a12 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.635778:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:2.0:1787604018.635781:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787604018.635785:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962000/0xb5d1f3b1a19023e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d99 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.635815:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:2.0:1787604018.635818:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787604018.635822:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595600/0xb5d1f3b1a1901d1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bbd expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.635881:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ed291bd5500) 00010000:00010000:2.0:1787604018.635884:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787604018.635889:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e600/0xb5d1f3b1a1901d45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5bcb expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.635909:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ed291bd5100) 00010000:00010000:2.0:1787604018.635911:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787604018.635916:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad200/0xb5d1f3b1a19023b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5d8b expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.635933:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ed290d35c00) 00010000:00010000:2.0:1787604018.635935:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787604018.635939:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ea00/0xb5d1f3b1a1901a19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5af9 expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.635955:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:2.0:1787604018.635957:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787604018.635962:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dad400/0xb5d1f3b1a19016bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5a0b expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.635977:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:2.0:1787604018.635980:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787604018.635990:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595c00/0xb5d1f3b1a19020b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5cc7 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604018.636006:0:5810:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ed285c15800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787604018.636022:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604018.636024:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604018.636026:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787604018.636366:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1787604018.637023:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a45d6158-dc8e-48e6-b534-483bf3fa20ad+7:2362:x1874438345825280:12345-192.168.202.21@tcp:39:umount.0 Request processed in 2023us (7333us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787604018.637036:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 240 00000001:00080000:3.0:1787604018.723263:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1787604018.723299:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000001:00080000:3.0:1787604018.723307:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787604018.723314:0:5844:0:(genops.c:885:class_export_put()) final put ffff9ed285c15800/a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000020:00000080:3.0:1787604018.723360:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed285c15800/a45d6158-dc8e-48e6-b534-483bf3fa20ad for lustre-MDT0000 00000020:00000080:3.0:1787604018.723444:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed1835b9000 for lustre-MDT0000 00000001:00100000:0.0:1787604018.724673:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000020:00000080:0.0:1787604018.724683:0:7632:0:(genops.c:885:class_export_put()) final put ffff9ed2863f6800/a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000020:00000080:3.0:1787604018.725403:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2863f6800/a45d6158-dc8e-48e6-b534-483bf3fa20ad for lustre-OST0001 00000020:00000080:3.0:1787604018.725472:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2863f3800 for lustre-OST0001 00000100:00100000:0.0:1787604019.161534:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355238912:0@lo:400:kworker.0 00000100:00100000:0.0:1787604019.161652:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604019.161736:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787604019.161743:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355238784:0@lo:400:kworker.0 00000100:00100000:0.0:1787604019.161772:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604019.161792:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355239296:0@lo:400:kworker.0 00000100:00100000:3.0:1787604019.161794:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355239040:0@lo:400:kworker.0 00000100:00100000:0.0:1787604019.161822:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604019.161869:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355239296 00000100:00100000:3.0:1787604019.161880:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355239296 00000100:00100000:0.0:1787604019.161882:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355238912 00000100:00100000:0.0:1787604019.161885:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355238912 00000100:00100000:1.0:1787604019.161950:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355238656:0@lo:400:kworker.0 00000100:00100000:1.0:1787604019.161992:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604019.162017:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355239168:0@lo:400:kworker.0 00000100:00100000:0.0:1787604019.162022:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355238784 00000100:00100000:0.0:1787604019.162025:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355238784 00000100:00100000:0.0:1787604019.162055:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787604019.162064:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604019.162067:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed290176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355238912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604019.162110:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355239168 00000100:00100000:1.0:1787604019.162114:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355239168 00000100:00100000:1.0:1787604019.162139:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787604019.162146:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355238784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604019.162179:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355238784:12345-0@lo:400:kworker.0 Request processed in 33us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604019.162187:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787604019.162206:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787604019.162212:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355239168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604019.162261:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355239168:12345-0@lo:400:kworker.0 Request processed in 49us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604019.162262:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed290176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355238912:12345-0@lo:400:kworker.0 Request processed in 198us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604019.162268:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787604019.162367:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787604019.162376:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355239424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787604019.162407:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604019.162437:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355239424 00000100:00100000:2.0:1787604019.162441:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355239424 00000100:00100000:2.0:1787604019.162471:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787604019.162478:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355239424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787604019.162512:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604019.162550:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355239424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604019.162556:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787604019.162606:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355239424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787604019.162648:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787604019.162679:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787604019.162685:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787604019.162687:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787604019.162706:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355238656 00000100:00100000:2.0:1787604019.162710:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355238656 00000100:00100000:2.0:1787604019.162737:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787604019.162744:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355238656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604019.162776:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355238656:12345-0@lo:400:kworker.0 Request processed in 33us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604019.162792:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787604019.166436:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787604019.166465:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355239040 00000100:00100000:3.0:1787604019.166478:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355239040 00000100:00100000:3.0:1787604019.166508:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787604019.166519:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355239296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604019.166546:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355238784:0@lo:400:kworker.0 00000100:00100000:0.0:1787604019.166563:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355238912:0@lo:400:kworker.0 00000100:00100000:3.0:1787604019.166636:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355239296:12345-0@lo:400:kworker.0 Request processed in 119us (4812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604019.166638:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355238656:0@lo:400:kworker.0 00000100:00100000:3.0:1787604019.166643:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787604019.166652:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355239168:0@lo:400:kworker.0 00000100:00100000:3.0:1787604019.166656:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787604019.166662:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355239040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604019.166760:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355239296:0@lo:400:kworker.0 00000100:00100000:3.0:1787604019.167025:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355239040:12345-0@lo:400:kworker.0 Request processed in 362us (4375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604019.167033:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787604019.174890:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355239040:0@lo:400:kworker.0 00010000:00010000:2.0:1787604019.610383:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604019.671357:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355239552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787604019.671462:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604019.676095:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355239552 00000100:00100000:2.0:1787604019.676117:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355239552 00000100:00100000:2.0:1787604019.676219:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787604019.676233:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355239552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787604019.676285:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604019.679377:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355239552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3133us (7900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604019.679395:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787604019.679956:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355239552:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787604020.632706:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604020.679636:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604020.679725:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345825408 00000100:00100000:1.0:1787604020.679740:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345825408 00000100:00100000:1.0:1787604020.679824:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 22 00000100:00100000:1.0:1787604020.679869:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2364:x1874438345825408:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604020.679890:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604020.679935:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217c400/0xb5d1f3b1a19014c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5947 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604020.679959:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604020.680034:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f844a97d-1878-4049-bbc8-d860aeb2443e+9:2364:x1874438345825408:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 198us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604020.680051:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 22 00000100:00100000:2.0:1787604020.681255:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604020.681332:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604020.682787:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345825664 00000100:00100000:1.0:1787604020.682804:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345825664 00000100:00100000:1.0:1787604020.682893:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345825536 00000100:00100000:1.0:1787604020.682896:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345825536 00000100:00100000:1.0:1787604020.682939:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 23 00000100:00100000:1.0:1787604020.682952:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f844a97d-1878-4049-bbc8-d860aeb2443e+10:2364:x1874438345825664:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604020.682972:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604020.683000:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5daca00/0xb5d1f3b1a190168b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e59f6 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604020.683022:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787604020.683052:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 24 00000100:00100000:3.0:1787604020.683062:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b613a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+9:2364:x1874438345825536:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787604020.683073:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604020.683082:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217ce00/0xb5d1f3b1a19014cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5971 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604020.683094:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604020.683108:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f844a97d-1878-4049-bbc8-d860aeb2443e+8:2364:x1874438345825664:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 159us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604020.683112:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b613a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f844a97d-1878-4049-bbc8-d860aeb2443e+8:2364:x1874438345825536:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 53us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604020.683116:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 23 00000100:00100000:3.0:1787604020.683139:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 24 00000100:00100000:2.0:1787604020.685731:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604020.685953:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345825920 00000100:00100000:0.0:1787604020.685967:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345825920 00000100:00100000:0.0:1787604020.686094:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 241 00000100:00100000:0.0:1787604020.686126:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+6:2362:x1874438345825920:12345-192.168.202.21@tcp:39:umount.0 00000020:00000080:0.0:1787604020.686198:0:5822:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19014d9 00000020:00010000:0.0:1787604020.686208:0:5822:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ed2ba363800: total 0 00000100:00080000:0.0:1787604020.686214:0:5822:0:(import.c:65:import_set_state_nolock()) ffff9ed2ba360800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787604020.686248:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787604020.686724:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:649d83ee-97a0-4141-af13-8dc5b7a4524e+5:2362:x1874438345825920:12345-192.168.202.21@tcp:39:umount.0 Request processed in 597us (1001us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787604020.686734:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 241 00000020:00010000:1.0:1787604020.686991:0:5810:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ed2ba363800: total 0 00010000:00010000:1.0:1787604020.686998:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604020.687046:0:5810:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ed2ba363800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787604020.687078:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b900) 00010000:00010000:1.0:1787604020.687081:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787604020.687089:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b5dac200/0xb5d1f3b1a1902406 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5da7 expref: 4 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604020.687134:0:5810:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ed2ba363800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787604020.687145:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604020.687147:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604020.687148:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787604020.687583:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787604020.704557:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604020.704658:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345826176 00000100:00100000:3.0:1787604020.704673:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345826176 00000100:00100000:3.0:1787604020.704746:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 305 00000100:00100000:3.0:1787604020.704759:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+7:2362:x1874438345826176:12345-192.168.202.21@tcp:251:umount.0 00000020:00000080:3.0:1787604020.704820:0:5815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19013cf 00000020:00010000:3.0:1787604020.704830:0:5815:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ed285c12800: total 0 00000100:00080000:3.0:1787604020.704874:0:5815:0:(import.c:65:import_set_state_nolock()) ffff9ed285c16800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787604020.704970:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f844a97d-1878-4049-bbc8-d860aeb2443e+3:2362:x1874438345826176:12345-192.168.202.21@tcp:251:umount.0 Request processed in 213us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604020.704979:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 305 00000020:00010000:0.0:1787604020.705174:0:6692:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ed285c12800: total 0 00010000:00010000:0.0:1787604020.705241:0:6692:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ed285c12800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787604020.705284:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed281498800/0xb5d1f3b1a1901423 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5939 expref: 2 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604020.705302:0:6692:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ed285c12800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787604020.705322:0:6692:0:(genops.c:885:class_export_put()) final put ffff9ed285c12800/f844a97d-1878-4049-bbc8-d860aeb2443e 00010000:00010000:0.0:1787604020.705340:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604020.705342:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604020.705344:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787604020.705482:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed285c12800/f844a97d-1878-4049-bbc8-d860aeb2443e for MGS 00000020:00000080:3.0:1787604020.705525:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed285c16800 for MGS 00010000:00010000:1.0:1787604021.659879:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787604022.354386:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000020:00000080:2.0:1787604022.354402:0:6705:0:(genops.c:885:class_export_put()) final put ffff9ed2863f2800/a45d6158-dc8e-48e6-b534-483bf3fa20ad 00000020:00000080:0.0:1787604022.354480:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2863f2800/a45d6158-dc8e-48e6-b534-483bf3fa20ad for lustre-OST0000 00000020:00000080:0.0:1787604022.354543:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2863f3000 for lustre-OST0000 00000020:01000004:2.0:1787604022.467605:0:12950:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787604022.486329:0:12950:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787604022.486481:0:12950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.486495:0:12950:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.486504:0:12950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.486512:0:12950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.486550:0:12950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787604022.486557:0:12950:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787604022.486604:0:12950:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787604022.486609:0:12950:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787604022.486616:0:12950:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787604022.486646:0:12950:0:(import.c:65:import_set_state_nolock()) ffff9ed2b5fde000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787604022.486876:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874438355239680:0@lo:39:umount.0 00000100:00100000:2.0:1787604022.486960:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787604022.487117:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604022.487127:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604022.487136:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2813a1800 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:0.0:1787604022.487140:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604022.487151:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787604022.487170:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604022.487249:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787604022.487252:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787604022.487255:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787604022.487290:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604022.487307:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787604022.487415:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604022.487424:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1800/0xb5d1f3b1a1901462 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901469 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604022.487439:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604022.487441:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604022.487443:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604022.487457:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355239808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787604022.487501:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604022.487602:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355239680 00000100:00100000:3.0:1787604022.487611:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355239680 00000100:00100000:3.0:1787604022.487664:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787604022.487671:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874438355239680:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787604022.487699:0:7875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19011ec 00000100:00080000:3.0:1787604022.487707:0:7875:0:(import.c:65:import_set_state_nolock()) ffff9ed2b5fc3800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787604022.487767:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3280:x1874438355239680:12345-0@lo:39:umount.0 Request processed in 96us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604022.487772:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1787604022.487782:0:7875:0:(genops.c:885:class_export_put()) final put ffff9ed285eab800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1787604022.487823:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2b5fde000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787604022.487831:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874438355239680:0@lo:39:umount.0 00000020:00000080:3.0:1787604022.487875:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed285eab800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787604022.487918:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2b5fc3800 for lustre-MDT0000 00000100:00080000:3.0:1787604022.487931:0:12950:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787604022.487934:0:12950:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787604022.487937:0:12950:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787604022.489121:0:12950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489140:0:12950:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489148:0:12950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489171:0:12950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489616:0:12950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604022.489627:0:12950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489637:0:12950:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489644:0:12950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489651:0:12950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489682:0:12950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787604022.489693:0:12950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489699:0:12950:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489707:0:12950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604022.489712:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787604022.489714:0:12950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604022.489737:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489751:0:12950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787604022.489756:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dada00 already unused, calling callback (ffffffffc1dfec20) 00010000:00010000:3.0:1787604022.489761:0:12950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed281499400/0xb5d1f3b1a190113d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604022.489763:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604022.489777:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489793:0:12950:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed281499400/0xb5d1f3b1a190113d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489800:0:12950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed281499400/0xb5d1f3b1a190113d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489806:0:12950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed281499400/0xb5d1f3b1a190113d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604022.489814:0:12950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1787604022.489817:0:12950:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787604022.489880:0:12950:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787604022.489885:0:12950:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787604022.489890:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604022.489896:0:12950:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1787604022.489907:0:12950:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ed2bfd55000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787604022.489913:0:12950:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ed2bf079800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787604022.489921:0:12950:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9ed2ba363800 649d83ee-97a0-4141-af13-8dc5b7a4524e 192.168.202.21@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787604022.489927:0:12950:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9ed2b50bcd28) has exports, disconnecting them 00000020:00080000:3.0:1787604022.489932:0:12950:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ed2bfd55000), last request at 1787604019 00000020:00000080:3.0:1787604022.489940:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901351 00010000:00010000:2.0:1787604022.490167:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787604022.490184:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490194:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed280031200 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:2.0:1787604022.490197:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490214:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604022.490221:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604022.490228:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787604022.490230:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787604022.490233:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787604022.490285:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490301:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604022.490345:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490352:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed280031200/0xb5d1f3b1a1901389 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901390 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490374:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787604022.490377:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490384:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f200 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:2.0:1787604022.490387:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490394:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604022.490412:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604022.490418:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787604022.490420:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787604022.490421:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787604022.490436:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490442:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604022.490448:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490454:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190167d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901684 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490461:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604022.490465:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed281499400/0xb5d1f3b1a190113d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490470:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed281499400 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:2.0:1787604022.490473:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed281499400/0xb5d1f3b1a190113d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490479:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed281499400/0xb5d1f3b1a190113d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604022.490485:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed281499400/0xb5d1f3b1a190113d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604022.490500:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787604022.490502:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787604022.490504:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787604022.490517:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed281499400/0xb5d1f3b1a190113d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490523:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604022.490535:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed281499400/0xb5d1f3b1a190113d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490542:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed281499400/0xb5d1f3b1a190113d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901144 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604022.490556:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604022.490558:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604022.490560:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604022.490583:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355239936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604022.490668:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787604022.490833:0:12950:0:(import.c:65:import_set_state_nolock()) ffff9ed2bfd51800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787604022.490963:0:12950:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ed2bfd55000): rc 0 00000020:00000080:3.0:1787604022.490973:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2bfd55000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787604022.490988:0:12950:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ed2bf079800), last request at 1787604019 00000020:00000080:3.0:1787604022.490994:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901286 00000100:00080000:3.0:1787604022.491000:0:12950:0:(import.c:65:import_set_state_nolock()) ffff9ed2bf07a000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787604022.491014:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2bfd55000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787604022.491140:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2bfd51800 for lustre-MDT0000 00000020:00080000:3.0:1787604022.491156:0:12950:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ed2bf079800): rc 0 00000020:00000080:3.0:1787604022.491158:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2bf079800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1787604022.491170:0:12950:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb261415dbae0 00000020:00000080:3.0:1787604022.491197:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2bf079800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787604022.491244:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2bf07a000 for lustre-MDT0000 10000000:00010000:1.0:1787604022.491268:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604022.491277:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787604022.491281:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000100:00080000:3.0:1787604022.491283:0:12950:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787604022.491289:0:12950:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1787604022.491317:0:12950:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787604022.491406:0:12950:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787604022.491424:0:12950:0:(import.c:65:import_set_state_nolock()) ffff9ed2870d3000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787604022.491438:0:12950:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787604022.491440:0:12950:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1787604022.491459:0:12950:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787604022.491531:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355240320:0@lo:9:umount.0 00000100:00100000:3.0:1787604022.491589:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1787604022.491591:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1787604022.491649:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604022.491658:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787604022.491677:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787604022.491681:0:12950:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787604022.491697:0:12950:0:(import.c:65:import_set_state_nolock()) ffff9ed2c11c4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787604022.491714:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dada00/0xb5d1f3b1a1901470 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604022.491720:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355240576:0@lo:9:umount.0 00010000:00010000:1.0:1787604022.491737:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604022.491742:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604022.491746:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604022.491759:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604022.491784:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355240064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604022.491808:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355240320 00000100:00100000:3.0:1787604022.491818:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355240320 00000100:00100000:1.0:1787604022.491926:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355240192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604022.491941:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355240576 00000100:00100000:3.0:1787604022.491957:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355240576 00000100:00100000:3.0:1787604022.491991:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787604022.492002:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874438355240320:12345-0@lo:9:umount.0 00000100:00100000:1.0:1787604022.492144:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787604022.492159:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874438355240576:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787604022.492186:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19013ba 00000100:00080000:1.0:1787604022.492197:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9ed2c1c8c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787604022.492238:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:0.0:1787604022.492593:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604022.492853:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355240448:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1787604022.492923:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19012d3 00000100:00080000:3.0:1787604022.492933:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9ed2ba01a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787604022.492979:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787604022.493373:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3280:x1874438355240576:12345-0@lo:9:umount.0 Request processed in 1211us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604022.493391:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1787604022.494225:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604022.494374:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355239808 00000100:00100000:1.0:1787604022.494387:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355239808 00000100:00100000:3.0:1787604022.494453:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3280:x1874438355240320:12345-0@lo:9:umount.0 Request processed in 2441us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604022.494459:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355239936 00000100:00100000:3.0:1787604022.494465:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787604022.494465:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355239936 00000100:00080000:3.0:1787604022.494505:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787604022.494515:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787604022.494528:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787604022.494541:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2989fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+20:3284:x1874438355239808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787604022.494556:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604022.494579:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed298595000/0xb5d1f3b1a1901469 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a1901462 expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787604022.494612:0:12950:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ed2b50bcd28) has no exports 00010000:00010000:1.0:1787604022.494619:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604022.494694:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2989fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+19:3284:x1874438355239808:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (7191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604022.494705:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787604022.494770:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787604022.494779:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+18:3281:x1874438355239936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787604022.494789:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604022.494800:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217d000/0xb5d1f3b1a1901390 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a1901389 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604022.494813:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604022.494858:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a643876-f930-492c-81cb-9dcff9ce6b60+17:3281:x1874438355239936:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (4171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604022.494865:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787604022.495050:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2c11c4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787604022.495067:0:3280:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787604022.495069:0:3280:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787604022.495072:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355240576:0@lo:9:umount.0 00000100:00080000:1.0:1787604022.495089:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2870d3000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787604022.495099:0:3280:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787604022.495101:0:3280:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787604022.495103:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355240320:0@lo:9:umount.0 00010000:00010000:1.0:1787604022.495143:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604022.495751:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355239936:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604022.495796:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604022.497395:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604022.497484:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604022.497747:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355240192 00000100:00100000:1.0:1787604022.497757:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355240192 00000100:00100000:1.0:1787604022.497826:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355240064 00000100:00100000:1.0:1787604022.497829:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355240064 00000100:00100000:1.0:1787604022.497880:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787604022.497964:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+18:3283:x1874438355240192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787604022.498054:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604022.498075:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed280030e00/0xb5d1f3b1a1901144 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a190113d expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604022.498097:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604022.498160:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+17:3283:x1874438355240192:12345-0@lo:103:ldlm_bl.0 Request processed in 270us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604022.498168:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787604022.498192:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787604022.498199:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+16:3282:x1874438355240064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787604022.498207:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604022.498220:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1901684 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a190167d expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604022.498223:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787604022.498237:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604022.498307:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355239808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604022.498381:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:3282:x1874438355240064:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604022.498388:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787604022.498400:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355240448 00000100:00100000:1.0:1787604022.498404:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355240448 00000100:00100000:1.0:1787604022.498422:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787604022.498428:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+15:3284:x1874438355240448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787604022.498437:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604022.498445:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2813a0a00/0xb5d1f3b1a1901477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a1901470 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604022.498465:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604022.498503:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a643876-f930-492c-81cb-9dcff9ce6b60+14:3284:x1874438355240448:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604022.498511:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787604022.498544:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9a643876-f930-492c-81cb-9dcff9ce6b60:3284:1874438355240448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604022.498574:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355240192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604022.498629:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355240064:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787604022.509053:0:12950:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ed2b50bcd28) has no exports 00000020:00000080:2.0:1787604022.622322:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901198 00000020:00000080:2.0:1787604022.622338:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2b5fc7800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787604022.622352:0:12950:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787604022.622432:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604022.622454:0:12950:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787604022.622462:0:12950:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9ed2952fcd28) has no exports 00000020:00000080:1.0:1787604022.622477:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2b5fc7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787604022.623410:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901191 00000020:00000080:3.0:1787604022.623422:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2b5c8a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787604022.623563:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604022.623573:0:12950:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787604022.623577:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2c1b43800/lustre-QMT0000_UUID 00000020:00000080:3.0:1787604022.623580:0:12950:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2c1b43800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787604022.623595:0:12950:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787604022.623872:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2b5c8a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787604022.679875:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604023.703178:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787604023.831373:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 649d83ee-97a0-4141-af13-8dc5b7a4524e 00000001:00080000:3.0:1787604023.831392:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787604023.831397:0:5844:0:(genops.c:885:class_export_put()) final put ffff9ed2ba363800/649d83ee-97a0-4141-af13-8dc5b7a4524e 00000020:00000080:1.0:1787604023.831535:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba363800/649d83ee-97a0-4141-af13-8dc5b7a4524e for lustre-MDT0000 00000020:00000080:1.0:1787604023.831593:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2ba360800 for lustre-MDT0000 00000001:00100000:0.0:1787604023.845402:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787604023.845413:0:7632:0:(genops.c:885:class_export_put()) final put ffff9ed2c1c8d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787604023.845485:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2c1c8d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787604023.845543:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2c1c8c800 for lustre-OST0001 00000100:00100000:2.0:1787604024.279564:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355240704:0@lo:400:kworker.0 00000100:00100000:2.0:1787604024.279644:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604024.279706:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787604024.279727:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355240832:0@lo:400:kworker.0 00000100:00100000:2.0:1787604024.279767:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604024.279949:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355240960:0@lo:400:kworker.0 00000100:00100000:0.0:1787604024.279995:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604024.280249:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355240832 00000100:00100000:2.0:1787604024.280258:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355240832 00000100:00100000:2.0:1787604024.280311:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355240960 00000100:00100000:2.0:1787604024.280315:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355240960 00000100:00100000:2.0:1787604024.280348:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787604024.280355:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3281:x1874438355240832:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787604024.280363:0:5822:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787604024.280404:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3281:x1874438355240832:12345-0@lo:400:kworker.0 Request processed in 47us (636us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787604024.280411:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787604024.280429:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787604024.280434:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3283:x1874438355240960:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787604024.280438:0:5822:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787604024.280466:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3283:x1874438355240960:12345-0@lo:400:kworker.0 Request processed in 30us (470us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787604024.280471:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1787604024.280504:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787604024.280509:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9ed2c1c8e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787604024.280513:0:3283:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787604024.280967:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355240704 00000100:00100000:1.0:1787604024.280973:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355240704 00000100:00100000:1.0:1787604024.281018:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787604024.281025:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed29011e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:3281:x1874438355240704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604024.281297:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed29011e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a643876-f930-492c-81cb-9dcff9ce6b60+14:3281:x1874438355240704:12345-0@lo:400:kworker.0 Request processed in 272us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604024.281304:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:1.0:1787604024.281373:0:3281:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787604024.281376:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9ed2b6f7a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787604024.281380:0:3281:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787604024.281384:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9ed2b6f7a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787604024.281388:0:3281:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 142 00000100:00080000:1.0:1787604024.281393:0:3281:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ed2b6f7a800 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:1.0:1787604024.281428:0:3281:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2b4e0ea00 x1874438355241088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787604024.281449:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355240832:0@lo:400:kworker.0 00000100:00100000:1.0:1787604024.281462:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9a643876-f930-492c-81cb-9dcff9ce6b60:3281:1874438355240704:0@lo:400:kworker.0 00000100:00100000:1.0:1787604024.281488:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874438355241088:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787604024.281516:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604024.281555:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355241088 00000100:00100000:1.0:1787604024.281559:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355241088 00000100:00100000:1.0:1787604024.281578:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787604024.281583:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3280:x1874438355241088:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787604024.281600:0:5822:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1787604024.322441:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9ed2c1c8e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787604024.322454:0:3283:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 163 00000100:00080000:2.0:1787604024.322463:0:3283:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ed2c1c8e000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:2.0:1787604024.322504:0:3283:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2c1ec7100 x1874438355241216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787604024.323199:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355240960:0@lo:400:kworker.0 00000100:00100000:3.0:1787604024.323439:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3280:x1874438355241088:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 41852us (41919us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787604024.323451:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787604024.323510:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874438355241216:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787604024.323549:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787604024.323640:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2b6f7a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787604024.323646:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787604024.323649:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874438355241088:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787604024.326509:0:7875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355241216 00000100:00100000:0.0:1787604024.326522:0:7875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355241216 00000100:00100000:3.0:1787604024.326717:0:7875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787604024.326727:0:7875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3280:x1874438355241216:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1787604024.326759:0:7875:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787604024.326872:0:7875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3280:x1874438355241216:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 144us (3322us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787604024.326880:0:7875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1787604024.326955:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2c1c8e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787604024.326974:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787604024.326978:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874438355241216:0@lo:38:ptlrpcd_00_02.0 00000020:01000000:3.0:1787604024.664360:0:12950:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ed2aa67ac60 - data ffff9ed29e73bca8/ffff9ed2bf51b800 00000020:01000000:3.0:1787604024.664502:0:12950:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ed2864f3660 - data ffff9ed29e697bd0/ffff9ed290082400 00000001:00000004:3.0:1787604024.674209:0:12950:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:1.0:1787604024.733225:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787604024.821000:0:12950:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787604024.821010:0:12950:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787604024.821036:0:12950:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787604024.821110:0:12950:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787604024.823287:0:6871:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787604024.823295:0:6871:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1787604024.823309:0:6871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787604024.829369:0:12950:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787604024.829379:0:12950:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787604024.829402:0:12950:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787604024.829405:0:12950:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787604024.831771:0:8080:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787604024.831779:0:8080:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1787604024.831790:0:8080:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787604024.883964:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901160 00000020:00000080:2.0:1787604024.883977:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2ba01b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787604024.884680:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901175 00000020:00000080:2.0:1787604024.884686:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2ba018800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787604024.884692:0:12950:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787604024.884698:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604024.884706:0:12950:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787604024.884710:0:12950:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9ed286548000) has no exports 00000004:01000000:2.0:1787604024.884882:0:12950:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787604024.884888:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19013b3 00000020:00000080:2.0:1787604024.884892:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed285c14000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787604024.884896:0:12950:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787604024.884899:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604024.884905:0:12950:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787604024.884907:0:12950:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9ed2b6134d28) has no exports 00000020:00000080:2.0:1787604024.884913:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19013ac 00000020:00000080:2.0:1787604024.884915:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2c11c0800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787604024.885250:0:12950:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787604024.885255:0:12950:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787604024.885259:0:12950:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787604024.885265:0:12950:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787604024.885268:0:12950:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787604024.885310:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604024.885318:0:12950:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787604024.885334:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19012cc 00000020:00000080:2.0:1787604024.885339:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2ba367000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787604024.885343:0:12950:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787604024.885346:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604024.885349:0:12950:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787604024.885352:0:12950:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9ed2b50b99b8) has no exports 00000020:00000080:2.0:1787604024.885355:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19012c5 00000020:00000080:2.0:1787604024.885358:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2870d2800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787604024.885672:0:12950:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787604024.885675:0:12950:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787604024.885677:0:12950:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787604024.885680:0:12950:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787604024.885682:0:12950:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787604024.885706:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604024.885711:0:12950:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787604024.885734:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604024.885736:0:12950:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787604024.885759:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a190117c 00000020:00000080:2.0:1787604024.885764:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2ba01f800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787604024.885767:0:12950:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787604024.885771:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604024.885774:0:12950:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787604024.885776:0:12950:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9ed2b50bb370) has no exports 00000020:00000080:2.0:1787604024.885793:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604024.885796:0:12950:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787604024.885799:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901183 00000020:00000080:2.0:1787604024.885802:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2ba01c800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787604024.885809:0:12950:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ed29010d000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787604024.885811:0:12950:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ed29010d000 3 00000020:01000004:2.0:1787604024.885814:0:12950:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ed29010d000 from lustre-MDT0000 00000020:00000080:2.0:1787604024.885832:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604024.885861:0:12950:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787604024.885871:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2ba01e800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787604024.885874:0:12950:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba01e800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787604024.885884:0:12950:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787604024.885947:0:12950:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787604024.885951:0:12950:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787604024.885954:0:12950:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787604024.885957:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604024.885959:0:12950:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787604024.885966:0:12950:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9ed285fb8800 9a643876-f930-492c-81cb-9dcff9ce6b60 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787604024.885971:0:12950:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9ed2865499b8) has exports, disconnecting them 00000020:00080000:2.0:1787604024.885975:0:12950:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ed285fb8800), last request at 1787603791 00000020:00000080:2.0:1787604024.885989:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901121 00000020:00010000:2.0:1787604024.885993:0:12950:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ed285fb8800: total 8 00000100:00080000:2.0:1787604024.885997:0:12950:0:(import.c:65:import_set_state_nolock()) ffff9ed285fbb800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787604024.886021:0:12950:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ed285fb8800): rc 0 00000020:00080000:2.0:1787604024.886026:0:12950:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9ed2865499b8) has no exports 00000100:00100000:2.0:1787604024.886118:0:5816:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ed2870db000:5816] 2 exiting: rc = 0 00000020:00000080:0.0:1787604024.886356:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba01b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787604024.886370:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba018800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787604024.886374:0:8:0:(genops.c:885:class_export_put()) final put ffff9ed2c1b0c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787604024.886376:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2c1b0c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787604024.886381:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787604024.886497:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed285c14000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787604024.886501:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2c11c0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787604024.886506:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2c11c4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787604024.886509:0:8:0:(genops.c:885:class_export_put()) final put ffff9ed2ba24b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787604024.886511:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba24b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787604024.886515:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787604024.886537:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba367000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787604024.886543:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2870d2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787604024.886547:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2870d3000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787604024.886550:0:8:0:(genops.c:885:class_export_put()) final put ffff9ed2bf07d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787604024.886552:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2bf07d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787604024.886555:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787604024.886603:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba01f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787604024.886606:0:8:0:(genops.c:885:class_export_put()) final put ffff9ed2ba01f000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787604024.886614:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba01f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787604024.886617:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787604024.886749:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba01c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1787604024.886915:0:6692:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ed285fb8800: total 0 00010000:00010000:3.0:1787604024.886945:0:6692:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ed285fb8800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787604024.886974:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed281499000/0xb5d1f3b1a190143f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a1901438 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604024.886990:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed281498c00/0xb5d1f3b1a190144d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a1901446 expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604024.887025:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5dac400/0xb5d1f3b1a1901668 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a1901661 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604024.887035:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b4963800/0xb5d1f3b1a1901676 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a190166f expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604024.887058:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5dac600/0xb5d1f3b1a190145b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a1901454 expref: 5 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604024.887067:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2813a1600/0xb5d1f3b1a1901239 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a1901232 expref: 4 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604024.887079:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2bec7e000/0xb5d1f3b1a1901485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a190147e expref: 3 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604024.887089:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2c217cc00/0xb5d1f3b1a1901431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb5d1f3b1a190142a expref: 2 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604024.887099:0:6692:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ed285fb8800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787604024.887111:0:6692:0:(genops.c:885:class_export_put()) final put ffff9ed285fb8800/9a643876-f930-492c-81cb-9dcff9ce6b60 00010000:00010000:3.0:1787604024.887131:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604024.887133:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604024.887134:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604024.887160:0:5815:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ed287096600:5815] 1 exiting: rc = 0 00000020:00000080:0.0:1787604024.887306:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed285fb8800/9a643876-f930-492c-81cb-9dcff9ce6b60 for MGS 00000020:00000080:0.0:1787604024.887337:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed285fbb800 for MGS 00000100:00100000:2.0:1787604024.899980:0:5813:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ed287097200:5813] 0 exiting: rc = 1 00000100:00100000:3.0:1787604024.900218:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900227:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900233:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900239:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900245:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900251:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900279:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900286:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900291:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900299:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900305:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900310:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900317:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900322:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900328:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900333:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900338:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900343:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900349:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900355:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900361:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900366:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900371:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900376:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900381:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900386:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900392:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900397:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900402:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900409:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900414:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900419:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900426:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900432:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900437:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900442:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900448:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900453:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900458:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900464:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900468:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900480:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900485:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900490:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900496:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900501:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900506:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900511:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900517:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900522:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900527:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900532:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900537:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900542:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900547:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900552:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900557:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900561:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900566:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900571:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900576:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900581:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900586:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604024.900591:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787604024.901022:0:12950:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787604024.901026:0:12950:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1787604024.905682:0:12950:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ed2b4d02b40 - data ffff9ed2bf97ee58/ffff9ed2ba1d8000 00000020:01000000:3.0:1787604024.906467:0:12950:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ed2861e7cc0 - data ffff9ed2a4853bd0/ffff9ed2a7143c00 00000020:00000080:3.0:1787604024.907339:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901105 00000020:00000080:3.0:1787604024.907348:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed29844e000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787604024.907409:0:12950:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ed29010d000 from MGS, refs=2 00000020:01000004:3.0:1787604024.907413:0:12950:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ed29010d000 2 00000020:01000004:3.0:1787604024.907417:0:12950:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ed29010d000 from MGS 00000020:00000080:3.0:1787604024.907437:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604024.907445:0:12950:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787604024.907458:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed29844c800/MGS 00000020:00000080:3.0:1787604024.907461:0:12950:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed29844c800/MGS for MGS 00000020:01000000:3.0:1787604024.907468:0:12950:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787604024.907526:0:12950:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787604024.907531:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604024.907536:0:12950:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787604024.907550:0:12950:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ed2b5c8e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787604024.907557:0:12950:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9ed2952fb370) has exports, disconnecting them 00000020:00080000:3.0:1787604024.907562:0:12950:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ed2b5c8e000), last request at 1787603792 00000020:00000080:3.0:1787604024.907566:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19011d0 00000020:00080000:3.0:1787604024.907577:0:12950:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ed2b5c8e000): rc 0 00000020:00000080:3.0:1787604024.907582:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2b5c8e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787604024.910006:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed29844e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787604024.911747:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2b5c8e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787604024.912894:0:12950:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787604024.912902:0:12950:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787604024.912908:0:12950:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787604024.912916:0:12950:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787604024.915851:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2b5fde000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787604024.916184:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604024.916194:0:12950:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787604024.916200:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed2b5fd9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787604024.916204:0:12950:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2b5fd9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787604024.916218:0:12950:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787604024.916289:0:12950:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ed29010d000 1 00000020:00000080:2.0:1787604024.916297:0:12950:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19010f7 00000020:00000080:2.0:1787604024.916303:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed298448000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787604024.916330:0:12950:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787604024.916335:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604024.916340:0:12950:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787604024.916344:0:12950:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9ed2952f99b8) has no exports 00000020:00000080:0.0:1787604024.916421:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed298448000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787604024.944565:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787604024.944591:0:12950:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787604024.944597:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed29010b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787604024.944602:0:12950:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed29010b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787604024.944621:0:12950:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787604024.944817:0:12950:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ed29010f000 00000020:01000000:0.0:1787604024.944867:0:12950:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787604024.944872:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787604024.944878:0:12950:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787604024.944884:0:12950:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9ed28654b370) has no exports 00000100:00100000:0.0:1787604024.944990:0:5821:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ed2870c9200:5821] 0 exiting: rc = 1 00000100:00100000:3.0:1787604024.945527:0:5823:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ed2864f5a00:5823] 2 exiting: rc = 0 00000100:00100000:3.0:1787604024.945626:0:5822:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ed2864f4400:5822] 1 exiting: rc = 0 00000100:00100000:3.0:1787604024.945702:0:7875:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9ed287036000:7875] 3 exiting: rc = 0 00000100:00100000:0.0:1787604024.946402:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946412:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946420:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946425:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946430:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946435:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946440:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946446:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946452:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946457:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946463:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946480:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946486:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946491:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946498:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946503:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946510:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946517:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946524:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946529:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946535:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946540:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946546:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946552:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946559:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946565:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946571:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946576:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946582:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946588:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946593:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946600:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946606:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946612:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946618:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946625:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946630:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946638:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946648:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946656:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946661:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946667:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946672:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946678:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946683:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946689:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946701:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946707:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946732:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946740:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946746:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946751:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946758:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946764:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946770:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946775:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946780:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946785:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946793:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946800:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946808:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946814:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946822:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.946828:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.958816:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ed2864f4a00:5824] 0 exiting: rc = 1 00000100:00100000:2.0:1787604024.959097:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ed2864f4000:5825] 1 exiting: rc = 0 00000100:00100000:1.0:1787604024.959457:0:11963:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9ed2bfd63200:11963] 2 exiting: rc = 0 00000100:00100000:0.0:1787604024.959508:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959520:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959530:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959538:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959545:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959553:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959562:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959570:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959576:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959582:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959589:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959608:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959617:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959623:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959629:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959635:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959651:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959658:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959663:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959671:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959679:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959687:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959692:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959697:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959701:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959706:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959711:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959715:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959720:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959724:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959729:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959734:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959739:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959744:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959749:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959754:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959758:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959763:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959768:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959774:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959780:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959785:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959790:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959795:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959800:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959805:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959809:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959815:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959819:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959824:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959828:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959856:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959862:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959868:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959873:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959878:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959884:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959890:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959895:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959900:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959907:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959914:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959921:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.959929:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604024.961250:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ed2864f4600:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1787604024.961344:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ed2864f5e00:5828] 1 exiting: rc = 0 00000100:00100000:0.0:1787604024.961705:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961714:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961721:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961728:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961733:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961738:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961744:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961749:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961755:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961760:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961765:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961770:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961775:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961780:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961786:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961809:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961815:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961820:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961825:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961832:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961855:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961860:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961880:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961887:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961892:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961897:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961903:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961921:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961928:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961933:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961939:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961945:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.961950:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962144:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962152:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962158:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962163:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962168:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962176:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962196:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962203:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962210:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962216:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962223:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962229:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962237:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962245:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962250:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962255:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962261:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962267:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962299:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962307:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962312:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962318:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962324:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962332:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962345:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962351:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962357:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962364:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962369:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962377:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.962396:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.973887:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ed2865a5c00:5830] 1 exiting: rc = 0 00000100:00100000:2.0:1787604024.973913:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ed2864f5800:5829] 0 exiting: rc = 1 00000100:00100000:0.0:1787604024.974721:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974730:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974735:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974740:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974746:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974753:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974759:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974767:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974774:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974781:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974788:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974797:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974804:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974810:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974815:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974819:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974825:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974830:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974851:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974858:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974864:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974869:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974874:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974881:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974889:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974894:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974898:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974913:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974920:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974925:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974931:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974938:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974946:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974953:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974961:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974969:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974975:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974983:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974992:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.974998:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975163:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975168:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975175:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975181:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975188:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975195:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975202:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975208:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975214:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975221:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975228:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975236:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975242:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975249:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975257:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975264:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975282:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975291:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975298:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975305:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975312:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975320:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975336:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.975343:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604024.975866:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ed286aeb200:5832] 1 exiting: rc = 0 00000100:00100000:1.0:1787604024.977402:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ed286aeb400:5831] 0 exiting: rc = 1 00000100:00100000:0.0:1787604024.977746:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977755:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977761:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977766:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977770:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977775:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977783:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977789:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977796:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977803:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977826:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977833:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977856:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977863:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977868:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977874:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977878:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977883:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977888:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977892:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977897:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977902:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977907:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977911:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977917:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977922:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977927:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977932:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977938:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977942:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977947:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977952:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977956:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977971:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977977:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977982:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977987:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977992:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.977997:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978002:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978006:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978010:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978014:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978019:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978023:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978027:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978032:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978036:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978040:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978044:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978049:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978053:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978057:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978062:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978065:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978070:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978074:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978079:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978084:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978089:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978094:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978099:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978104:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.978109:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604024.979262:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ed286aebe00:5833] 0 exiting: rc = 1 00000100:00100000:0.0:1787604024.979379:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ed286aeae00:5834] 1 exiting: rc = 0 00000100:00100000:0.0:1787604024.979431:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979438:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979443:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979458:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979464:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979469:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979474:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979479:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979484:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979490:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979495:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979499:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979505:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979509:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979514:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979519:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979524:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979529:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979534:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979539:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979544:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979549:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979555:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979560:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979565:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979570:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979575:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979580:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979585:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979590:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979594:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979599:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979604:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979609:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979613:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979618:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979623:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979628:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979639:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979645:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979650:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979655:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979660:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979665:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979671:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979675:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979680:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979684:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979690:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979695:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979700:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979705:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979710:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979714:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979719:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979724:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979729:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979733:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979738:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979743:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979747:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979752:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979757:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.979762:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.980354:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ed286aea400:5837] 2 exiting: rc = 0 00000100:00100000:2.0:1787604024.980686:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ed290a5fc00:5835] 0 exiting: rc = 1 00000100:00100000:3.0:1787604024.980948:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ed2870c8000:5836] 1 exiting: rc = 0 00000100:00100000:0.0:1787604024.983721:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.983732:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.983740:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.983747:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.983757:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.983769:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.983774:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.983779:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.983797:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.983804:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984177:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984183:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984189:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984194:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984200:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984206:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984215:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984222:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984229:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984264:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984278:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984284:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984290:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984295:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984302:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984307:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984313:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984319:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984325:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984330:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984335:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984341:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984346:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984351:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984372:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984379:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984385:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984391:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984396:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984401:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984407:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984413:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984418:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984434:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984441:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984446:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984452:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984457:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984462:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984468:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984474:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984479:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984485:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984490:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984495:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984500:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984507:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984511:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984516:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984522:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984527:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984533:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984539:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604024.984553:0:12950:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787604024.993708:0:12950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604024.993722:0:12950:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787604024.993728:0:12950:0:(genops.c:885:class_export_put()) final put ffff9ed29844f800/MDS_uuid 00000020:00000080:2.0:1787604024.993732:0:12950:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed29844f800/MDS_uuid for MDS 00000020:01000000:2.0:1787604024.993744:0:12950:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787604024.993896:0:12950:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787604025.757140:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604026.778505:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787604027.447302:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787604027.447316:0:6705:0:(genops.c:885:class_export_put()) final put ffff9ed2ba019800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787604027.447357:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba019800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787604027.447430:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2ba01a000 for lustre-OST0000 00010000:00010000:3.0:1787604027.799127:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787604028.237118:0:13104:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787604028.245789:0:13104:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787604028.245878:0:13104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.245895:0:13104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.245902:0:13104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.245909:0:13104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.245946:0:13104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787604028.245953:0:13104:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1787604028.246832:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604028.246865:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.246875:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2813a0e00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:2.0:1787604028.246880:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.246891:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604028.246900:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604028.246907:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787604028.246909:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787604028.246912:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787604028.246966:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.247033:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604028.247068:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.247076:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2813a0e00/0xb5d1f3b1a1901446 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a190144d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.247093:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604028.247107:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604028.247109:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604028.247120:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787604028.247144:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355241344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604028.247234:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787604028.247337:0:13104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787604028.247343:0:13104:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787604028.247351:0:13104:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787604028.247359:0:13104:0:(import.c:65:import_set_state_nolock()) ffff9ed2b6f7a800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787604028.247365:0:13104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787604028.247367:0:13104:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787604028.247370:0:13104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1787604028.247912:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355241344 00000100:00100000:1.0:1787604028.247924:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355241344 00000100:00100000:1.0:1787604028.248043:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787604028.248053:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3283:x1874438355241344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787604028.248062:0:5808:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787604028 with bad export cookie 13101520735242817825 00010000:00010000:2.0:1787604028.250515:0:13104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.250540:0:13104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.250549:0:13104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.252061:0:13104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.252094:0:13104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604028.252106:0:13104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.252115:0:13104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.252143:0:13104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.252150:0:13104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604028.252176:0:13104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787604028.252182:0:13104:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787604028.252226:0:13104:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787604028.252234:0:13104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787604028.252252:0:13104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604028.252262:0:13104:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787604028.252269:0:13104:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ed2952f8000) has no exports 00000020:00080000:2.0:1787604028.252304:0:13104:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ed2952f8000) has no exports 00010000:00010000:3.0:1787604028.255085:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787604028.255101:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604028.255116:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2813a1c00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787604028.255122:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604028.255135:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604028.255144:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604028.255169:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787604028.255171:0:6692:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787604028.255175:0:6692:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787604028.255228:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604028.255234:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787604028.255295:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604028.255301:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1c00/0xb5d1f3b1a1901454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a190145b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604028.255317:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604028.255322:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604028.255326:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595400 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787604028.255329:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604028.255337:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604028.255344:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604028.255350:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787604028.255353:0:6692:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787604028.255355:0:6692:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787604028.255375:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604028.255379:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787604028.255384:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604028.255389:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a190166f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb5d1f3b1a1901676 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604028.255395:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604028.255396:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604028.255397:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604028.255980:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355241600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604028.256080:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604028.256153:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787604028.256158:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355241472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604028.256185:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604028.256471:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355241600 00000100:00100000:3.0:1787604028.256479:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355241600 00000100:00100000:3.0:1787604028.256510:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355241472 00000100:00100000:3.0:1787604028.256512:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355241472 00000100:00100000:3.0:1787604028.256521:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787604028.256528:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3282:x1874438355241600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787604028.256534:0:5806:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787604028 with bad export cookie 13101520735242817825 00000020:01000000:2.0:1787604028.262577:0:13104:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ed2b4d02600 - data ffff9ed2bf8921b0/ffff9ed2ba1da800 00000020:01000000:2.0:1787604028.262794:0:13104:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ed2aa688ba0 - data ffff9ed2a4b5b948/ffff9ed2bee77000 00000100:00100000:3.0:1787604028.263414:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3282:x1874438355241600:12345-0@lo:103:ldlm_bl.0 Request processed in 6874us (7325us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787604028.263431:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787604028.263483:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787604028.263490:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2989fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3282:x1874438355241472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787604028.263519:0:5806:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787604028 with bad export cookie 13101520735242817825 00000100:00100000:3.0:1787604028.263580:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2989fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3282:x1874438355241472:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (7393us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787604028.263587:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787604028.263645:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787604028.263651:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9ed29844c000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787604028.263655:0:3282:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1787604028.266517:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3283:x1874438355241344:12345-0@lo:103:ldlm_bl.0 Request processed in 18452us (19271us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787604028.266550:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1787604028.266629:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787604028.270016:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787604028.270650:0:3282:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.121@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787604028.270655:0:3282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787604028.270664:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ed2c1ec4000 x1874438355241344/t0(0) o103->MGC192.168.202.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787604044 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604028.270678:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ed2bf6d8380 x1874438355241600/t0(0) o103->MGC192.168.202.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787604044 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604028.270685:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ed2bf6dbb80 x1874438355241472/t0(0) o103->MGC192.168.202.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787604044 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787604028.270694:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787604028.270697:0:3282:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787604028.270698:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787604028.270742:0:3283:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9ed29844c000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787604028.270815:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9a643876-f930-492c-81cb-9dcff9ce6b60:3283:1874438355241344:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787604028.272939:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9ed29844c000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604028.272954:0:3282:0:(import.c:510:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 124 00000100:00080000:3.0:1787604028.272965:0:3282:0:(import.c:624:import_select_connection()) MGC192.168.202.121@tcp: import ffff9ed29844c000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:3.0:1787604028.273275:0:3282:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2bf6d9f80 x1874438355241728/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787604028.273326:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355241600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604028.273349:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9a643876-f930-492c-81cb-9dcff9ce6b60:3282:1874438355241472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604028.273719:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a643876-f930-492c-81cb-9dcff9ce6b60:3280:1874438355241728:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1787604028.274548:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874438355241728 offset 0 length 520: 4 00100000:10000000:2.0:1787604028.288366:0:13104:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787604028.314314:0:13104:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901255 00000020:00000080:1.0:1787604028.314330:0:13104:0:(genops.c:885:class_export_put()) final put ffff9ed2c1c8a000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787604028.314400:0:13104:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ed286a76000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787604028.314405:0:13104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ed286a76000 2 00000020:01000004:1.0:1787604028.314409:0:13104:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ed286a76000 from lustre-OST0000 00000020:00000080:1.0:1787604028.314446:0:13104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787604028.314461:0:13104:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787604028.314464:0:13104:0:(genops.c:885:class_export_put()) final put ffff9ed2b6f5e800/lustre-OST0000_UUID 00000020:00000080:1.0:1787604028.314468:0:13104:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2b6f5e800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787604028.314481:0:13104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787604028.314545:0:13104:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787604028.314551:0:13104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787604028.314627:0:13104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787604028.314634:0:13104:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787604028.314643:0:13104:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ed2beeaa000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787604028.314651:0:13104:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9ed2bf083370) has exports, disconnecting them 00000020:00080000:1.0:1787604028.314659:0:13104:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ed2beeaa000), last request at 1787603809 00000020:00000080:1.0:1787604028.314664:0:13104:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a190127f 00000020:00080000:1.0:1787604028.314676:0:13104:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ed2beeaa000): rc 0 00000020:00000080:1.0:1787604028.314682:0:13104:0:(genops.c:885:class_export_put()) final put ffff9ed2beeaa000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787604028.315320:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2c1c8a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787604028.316156:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2beeaa000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787604028.318006:0:13104:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787604028.318016:0:13104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604028.318036:0:13104:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787604028.318045:0:13104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787604028.318293:0:13104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787604028.318305:0:13104:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787604028.318314:0:13104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ed286a76000 1 00000020:00000080:0.0:1787604028.318323:0:13104:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a190120f 00000020:00000080:0.0:1787604028.318337:0:13104:0:(genops.c:885:class_export_put()) final put ffff9ed2ba018000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787604028.318344:0:13104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787604028.318349:0:13104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787604028.318354:0:13104:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787604028.318359:0:13104:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9ed2b50b8000) has no exports 00000020:00000080:2.0:1787604028.319542:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2b6f7a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787604028.319573:0:37:0:(genops.c:885:class_export_put()) final put ffff9ed2beea9800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787604028.319577:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2beea9800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787604028.319586:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787604028.319653:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba018000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787604028.348547:0:13104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787604028.348582:0:13104:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787604028.348590:0:13104:0:(genops.c:885:class_export_put()) final put ffff9ed2b5fc2000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787604028.348596:0:13104:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2b5fc2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787604028.348611:0:13104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787604028.348787:0:13104:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ed286a74800 00000020:02000400:0.0:1787604028.348874:0:13104:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787604028.823410:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787604029.398997:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9a643876-f930-492c-81cb-9dcff9ce6b60->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787604029.399020:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9a643876-f930-492c-81cb-9dcff9ce6b60->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604029.399024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787604029.399029:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787604029.399033:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ed2c1c8e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604029.399044:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 357 00000100:00080000:3.0:1787604029.399051:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787604029.399072:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ed2c1c8e000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:3.0:1787604029.399121:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2bf6dbb80 x1874438355241856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604029.399211:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874438355241856:0@lo:38:kworker.0 00000400:00000100:0.0:1787604029.399290:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874438355241856 offset 0 length 520: 4 00010000:00010000:0.0:1787604029.859465:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604030.871680:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787604031.465451:0:13255:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787604031.493442:0:13255:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787604031.493556:0:13255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604031.493574:0:13255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604031.493583:0:13255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604031.493613:0:13255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604031.493642:0:13255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787604031.493650:0:13255:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787604031.493678:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604031.493695:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ed2bf6dbb80 x1874438355241856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787604044 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604031.493714:0:13255:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787604031.493753:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2c1c8e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787604031.493759:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1787604031.493763:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874438355241856:0@lo:38:kworker.0 00000100:00080000:0.0:1787604031.493803:0:13255:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787604031.493810:0:13255:0:(import.c:65:import_set_state_nolock()) ffff9ed2c1c8e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787604031.493815:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604031.493817:0:13255:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787604031.493821:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787604031.494791:0:13255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604031.494812:0:13255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604031.494820:0:13255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604031.494827:0:13255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604031.495904:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604031.495919:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604031.496476:0:13255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604031.496492:0:13255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604031.496501:0:13255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604031.496508:0:13255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604031.496515:0:13255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604031.496592:0:13255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787604031.496598:0:13255:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787604031.496636:0:13255:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787604031.496642:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787604031.496649:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787604031.496656:0:13255:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787604031.496663:0:13255:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ed2bf0819b8) has no exports 00000020:00080000:0.0:1787604031.496697:0:13255:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ed2bf0819b8) has no exports 00000020:01000000:0.0:1787604031.498506:0:13255:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ed2b4d02a80 - data ffff9ed2a4812d80/ffff9ed2b4bf3800 00000020:01000000:0.0:1787604031.498733:0:13255:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ed2aa688720 - data ffff9ed2bf97e1b0/ffff9ed2bf692800 00010000:00010000:3.0:1787604031.505315:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed281499200 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787604031.505332:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604031.505351:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604031.505361:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604031.505368:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787604031.505371:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787604031.505375:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787604031.505399:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ed29844c000 00010000:00010000:3.0:1787604031.505426:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604031.505434:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed281499200/0xb5d1f3b1a190142a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb5d1f3b1a1901431 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604031.505456:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787604031.505461:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604031.505467:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217ca00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787604031.505470:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604031.505477:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604031.505483:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604031.505488:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787604031.505490:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787604031.505492:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787604031.505498:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ed29844c000 00010000:00010000:3.0:1787604031.505501:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604031.505508:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2c217ca00/0xb5d1f3b1a1901438 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb5d1f3b1a190143f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604031.505518:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604031.505529:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604031.505536:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e200 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787604031.505539:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604031.505546:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604031.505553:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604031.505558:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787604031.505560:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787604031.505562:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787604031.505568:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ed29844c000 00010000:00010000:3.0:1787604031.505571:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604031.505577:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1901661 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb5d1f3b1a1901668 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604031.505593:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604031.505595:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604031.509447:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604031.509474:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604031.512874:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787604031.526222:0:13255:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787604031.569398:0:13255:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901320 00000020:00000080:2.0:1787604031.569429:0:13255:0:(genops.c:885:class_export_put()) final put ffff9ed286a22000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787604031.569494:0:13255:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ed2b4d09000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787604031.569499:0:13255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ed2b4d09000 2 00000020:01000004:2.0:1787604031.569503:0:13255:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ed2b4d09000 from lustre-OST0001 00000020:00000080:2.0:1787604031.569536:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604031.569550:0:13255:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787604031.569553:0:13255:0:(genops.c:885:class_export_put()) final put ffff9ed286a24000/lustre-OST0001_UUID 00000020:00000080:2.0:1787604031.569557:0:13255:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed286a24000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787604031.569572:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787604031.569715:0:13255:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9a643876-f930-492c-81cb-9dcff9ce6b60->MGS 00010000:00010000:2.0:1787604031.569740:0:13255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1e00/0xb5d1f3b1a1901232 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a1901239 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604031.569754:0:13255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1e00/0xb5d1f3b1a1901232 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a1901239 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604031.569775:0:13255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787604031.569779:0:13255:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787604031.569783:0:13255:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787604031.569804:0:13255:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ed29844c000 00010000:00010000:2.0:1787604031.569809:0:13255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2813a1e00/0xb5d1f3b1a1901232 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb5d1f3b1a1901239 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604031.569830:0:13255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a190147e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb5d1f3b1a1901485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604031.569870:0:13255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a190147e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb5d1f3b1a1901485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604031.569875:0:13255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787604031.569878:0:13255:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787604031.569880:0:13255:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787604031.569900:0:13255:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ed29844c000 00010000:00010000:2.0:1787604031.569904:0:13255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a190147e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb5d1f3b1a1901485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787604031.569927:0:13255:0:(import.c:65:import_set_state_nolock()) ffff9ed29844c000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787604031.569932:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787604031.569935:0:13255:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787604031.569937:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787604031.569956:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787604031.569973:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ed2bf6d9f80 x1874438355241728/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787604038 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787604031.570001:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787604031.570005:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1787604031.570141:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9a643876-f930-492c-81cb-9dcff9ce6b60:3280:1874438355241728:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:2.0:1787604031.570283:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787604031.570292:0:13255:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a1901113 00000020:00000080:2.0:1787604031.570298:0:13255:0:(genops.c:885:class_export_put()) final put ffff9ed29844d800/9a643876-f930-492c-81cb-9dcff9ce6b60 00000020:00000080:0.0:1787604031.572338:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed286a22000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787604031.572562:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.121@tcp (flags='') 00000020:00000080:2.0:1787604031.572579:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604031.572589:0:13255:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.121@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787604031.572595:0:13255:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9ed28654cd28) has no exports 10000000:01000000:1.0:1787604031.572685:0:5818:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787604031.572970:0:13255:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.121@tcp: client import never connected 00000100:00080000:2.0:1787604031.572974:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787604031.572979:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787604031.572983:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787604031.572985:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787604031.573152:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed29844d800/9a643876-f930-492c-81cb-9dcff9ce6b60 for MGC192.168.202.121@tcp 00000020:00000080:2.0:1787604031.573340:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604031.573350:0:13255:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.121@tcp (uuid 9a643876-f930-492c-81cb-9dcff9ce6b60) 00000020:01000000:2.0:1787604031.573361:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787604031.573367:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604031.573371:0:13255:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787604031.573380:0:13255:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ed2c1c8d000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787604031.573386:0:13255:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9ed2ba1eb370) has exports, disconnecting them 00000020:00080000:2.0:1787604031.573413:0:13255:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ed2c1c8d000), last request at 1787603830 00000020:00000080:2.0:1787604031.573420:0:13255:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a190134a 00000020:00080000:2.0:1787604031.573439:0:13255:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ed2c1c8d000): rc 0 00000020:00000080:2.0:1787604031.573444:0:13255:0:(genops.c:885:class_export_put()) final put ffff9ed2c1c8d000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787604031.573469:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed29844c000 for MGC192.168.202.121@tcp 00000020:00000080:0.0:1787604031.573476:0:36:0:(genops.c:885:class_export_put()) final put ffff9ed298448800/9a643876-f930-492c-81cb-9dcff9ce6b60 00000020:00000080:0.0:1787604031.573485:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed298448800/9a643876-f930-492c-81cb-9dcff9ce6b60 for MGC192.168.202.121@tcp 00000020:01000000:0.0:1787604031.573490:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.121@tcp (9a643876-f930-492c-81cb-9dcff9ce6b60) 00000020:00000080:0.0:1787604031.575570:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2c1c8d000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787604031.575920:0:13255:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787604031.575926:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604031.575931:0:13255:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787604031.575938:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787604031.576074:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1787604031.576359:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ed2c1c8e000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787604031.576397:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787604031.576555:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787604031.576745:0:5805:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ed298450600:5805] 1 exiting: rc = 0 00000100:00100000:1.0:1787604031.576817:0:5804:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ed298451e00:5804] 0 exiting: rc = 1 00000100:00100000:0.0:1787604031.576945:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.577504:0:5806:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ed298451c00:5806] 0 exiting: rc = 1 00000100:00100000:1.0:1787604031.577575:0:5808:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ed298451200:5808] 2 exiting: rc = 0 00000100:00100000:0.0:1787604031.577670:0:6693:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ed2bee7b800:6693] 3 exiting: rc = 0 00000100:00100000:3.0:1787604031.580792:0:5807:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ed298451000:5807] 1 exiting: rc = 0 00000100:00100000:0.0:1787604031.580968:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.580979:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.580987:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.580995:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581000:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581007:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581014:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581021:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581028:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581034:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581041:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581049:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581054:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581062:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581069:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581075:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581083:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581093:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581099:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581105:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581111:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581252:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581276:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581282:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581289:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581296:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581305:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581311:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581316:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581321:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581327:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581333:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581340:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581346:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581351:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581357:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581364:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581370:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581376:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581382:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581388:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581394:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581399:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581425:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581432:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581438:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581444:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581450:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581455:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581460:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581465:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581470:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581476:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581481:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581487:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581493:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581499:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581512:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581518:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581526:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581531:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581537:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581545:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.581551:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787604031.583094:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787604031.583112:0:13255:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787604031.583131:0:13255:0:(genops.c:885:class_export_put()) final put ffff9ed2c1b47000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787604031.583138:0:13255:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2c1b47000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787604031.583144:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787604031.583331:0:13255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ed2b4d09000 1 00000020:00000080:0.0:1787604031.583340:0:13255:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb5d1f3b1a19012ef 00000020:00000080:0.0:1787604031.583349:0:13255:0:(genops.c:885:class_export_put()) final put ffff9ed2bfd55800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787604031.583369:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787604031.583375:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787604031.583382:0:13255:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787604031.583387:0:13255:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9ed2bf080000) has no exports 00000020:00000080:1.0:1787604031.584059:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2bfd55800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787604031.600951:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787604031.600975:0:13255:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787604031.600982:0:13255:0:(genops.c:885:class_export_put()) final put ffff9ed2b4d0a000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787604031.600988:0:13255:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2b4d0a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787604031.601000:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787604031.601737:0:13255:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ed2b4d0f000 00000020:01000000:1.0:1787604031.601776:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787604031.601784:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787604031.601792:0:13255:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787604031.601798:0:13255:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9ed2b9ee8000) has no exports 00000020:00000080:1.0:1787604031.601867:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787604031.601877:0:13255:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787604031.601881:0:13255:0:(genops.c:885:class_export_put()) final put ffff9ed2ba01d000/OSS_uuid 00000020:00000080:1.0:1787604031.601883:0:13255:0:(genops.c:844:class_export_destroy()) destroying export ffff9ed2ba01d000/OSS_uuid for OSS 00000020:01000000:1.0:1787604031.601888:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787604031.602001:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ed2af3ada00:6679] 2 exiting: rc = 0 00000100:00080000:3.0:1787604031.604449:0:5817:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787604031.604707:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ed2b4974800:6678] 1 exiting: rc = 0 00000100:00100000:3.0:1787604031.604777:0:10671:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ed2b61d4000:10671] 3 exiting: rc = 0 00000100:00100000:3.0:1787604031.604874:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ed2af3ace00:6676] 0 exiting: rc = 1 00000100:00100000:1.0:1787604031.605544:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605556:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605563:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605572:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605578:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605584:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605591:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605597:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605604:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605623:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605629:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605636:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605655:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605662:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605669:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605675:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605682:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605688:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605695:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605701:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605707:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605713:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605719:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605724:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605731:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605737:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605743:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605749:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605755:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605762:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605768:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605773:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605779:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605785:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605791:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605797:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605803:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605810:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605815:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605822:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605828:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605852:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605860:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605866:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605882:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605888:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605894:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605899:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605904:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605911:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605917:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605923:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605928:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605934:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605939:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605944:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605954:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605960:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605965:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605970:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605976:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605981:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605988:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604031.605994:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604031.608669:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ed2b61d4400:6681] 1 exiting: rc = 0 00000100:00100000:3.0:1787604031.611179:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ed2b61d4800:6680] 0 exiting: rc = 1 00000100:00100000:0.0:1787604031.611282:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611297:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611304:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611313:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611322:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611331:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611338:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611357:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611366:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611373:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611381:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611388:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611395:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611403:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611409:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611434:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611440:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611447:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611453:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611460:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611466:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611473:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611481:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611488:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611494:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611502:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611509:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611517:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611525:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611533:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611539:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611546:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611553:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611559:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611565:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611571:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611580:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611586:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611593:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611599:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611605:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611611:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611618:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611623:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611629:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611634:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611639:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611645:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611651:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611656:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611670:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611677:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611688:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611693:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611699:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611704:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611711:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611717:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611722:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611729:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611734:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611740:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611746:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.611753:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.612824:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ed2b5ca2800:6684] 2 exiting: rc = 0 00000100:00100000:0.0:1787604031.613084:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ed2b61d4a00:6683] 1 exiting: rc = 0 00000100:00100000:3.0:1787604031.617013:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ed2b61d4c00:6682] 0 exiting: rc = 1 00000100:00100000:0.0:1787604031.617195:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617207:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617224:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617243:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617256:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617267:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617276:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617282:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617289:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617295:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617302:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617309:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617315:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617322:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617328:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617334:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617340:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617346:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617352:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617391:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617399:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617405:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617411:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617417:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617423:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617430:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617437:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617444:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617451:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617457:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617464:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617470:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617477:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617484:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617491:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617497:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617503:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617509:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617515:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617522:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617528:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617534:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617540:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617562:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617572:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617578:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617586:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617592:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617599:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617605:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617612:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617620:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617627:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617634:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617655:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617662:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617678:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617687:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617693:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617701:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617707:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617714:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617720:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.617727:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.624911:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ed2b5ca2c00:6686] 1 exiting: rc = 0 00000100:00100000:1.0:1787604031.625128:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ed2b5ca3a00:6685] 0 exiting: rc = 1 00000100:00100000:0.0:1787604031.625554:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625564:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625570:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625576:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625582:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625588:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625594:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625600:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625606:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625613:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625621:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625626:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625632:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625651:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625658:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625665:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625670:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625676:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625683:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625688:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625694:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625699:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625705:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625710:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625735:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625742:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625749:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625755:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625760:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625767:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625774:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625780:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625786:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625791:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625797:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625803:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625809:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625816:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625822:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625828:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625834:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625862:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625869:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625875:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625881:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625886:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625892:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625897:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625903:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625909:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625915:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625921:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625926:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625931:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625937:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625942:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625948:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625954:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625960:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625975:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625980:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625986:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625992:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.625998:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.627059:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ed29d951600:6687] 0 exiting: rc = 1 00000100:00100000:0.0:1787604031.633474:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ed2aa4ba800:6688] 1 exiting: rc = 0 00000100:00100000:0.0:1787604031.633655:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633666:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633672:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633682:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633692:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633700:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633708:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633715:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633723:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633731:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633740:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633749:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633791:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633799:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633806:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633813:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633821:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633828:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633834:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633863:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633871:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633879:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633886:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633893:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633921:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633930:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633937:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633945:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633974:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633981:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633991:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.633999:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634006:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634013:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634020:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634027:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634051:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634059:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634067:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634074:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634081:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634088:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634095:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634105:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634112:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634120:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634126:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634133:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634158:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634166:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634174:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634182:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634190:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634202:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634224:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634232:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634242:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634249:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634257:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634264:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634289:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634297:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634304:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604031.634321:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787604031.656660:0:13255:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787604048.685729:0:13870:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787604056.503305:0:14333:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787604056.503310:0:14333:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787604056.503414:0:14333:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ed283965800 00000020:01000004:0.0:1787604056.503430:0:14333:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787604056.503438:0:14333:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787604056.503453:0:14333:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ed2b6134d28) 00000020:00000080:0.0:1787604056.503466:0:14333:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787604056.517036:0:14333:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787604056.519936:0:14333:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1787604056.520283:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1787604056.520374:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1787604056.520545:0:14333:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787604056.520609:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1787604056.520707:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1787604056.521000:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1787604056.521101:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1787604056.521349:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1787604056.522600:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 590: rc = 0 00100000:10000000:0.0:1787604056.522706:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 590: rc = 0 00100000:10000000:0.0:1787604056.523285:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:0.0:1787604056.523610:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1787604056.523971:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:0.0:1787604056.524229:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1787604056.524470:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:0.0:1787604056.524703:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1787604056.525142:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:0.0:1787604056.525378:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1787604056.525620:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1787604056.526105:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:0.0:1787604056.526568:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:0.0:1787604056.527098:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1787604056.527621:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 67: rc = 0 00100000:10000000:0.0:1787604056.527970:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 67: rc = 0 00100000:10000000:0.0:1787604056.528232:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 67: rc = 0 00100000:10000000:0.0:1787604056.528490:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 67: rc = 0 00100000:10000000:0.0:1787604056.528982:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 67: rc = 0 00100000:10000000:0.0:1787604056.529306:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 67: rc = 0 00100000:10000000:0.0:1787604056.529539:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 67: rc = 0 00100000:10000000:0.0:1787604056.530057:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 67: rc = 0 00100000:10000000:0.0:1787604056.530304:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 67: rc = 0 00100000:10000000:0.0:1787604056.530978:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 67: rc = 0 00100000:10000000:0.0:1787604056.531363:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 67: rc = 0 00100000:10000000:0.0:1787604056.531609:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 67: rc = 0 00100000:10000000:0.0:1787604056.531980:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 67: rc = 0 00100000:10000000:0.0:1787604056.532252:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 67: rc = 0 00100000:10000000:0.0:1787604056.532480:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 67: rc = 0 00100000:10000000:0.0:1787604056.532712:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 67: rc = 0 00100000:10000000:0.0:1787604056.533138:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 67: rc = 0 00100000:10000000:0.0:1787604056.533387:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 67: rc = 0 00100000:10000000:0.0:1787604056.533618:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 67: rc = 0 00100000:10000000:0.0:1787604056.534084:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 67: rc = 0 00100000:10000000:0.0:1787604056.534455:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 67: rc = 0 00100000:10000000:0.0:1787604056.534708:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 67: rc = 0 00100000:10000000:0.0:1787604056.535253:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 67: rc = 0 00100000:10000000:0.0:1787604056.535502:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 67: rc = 0 00100000:10000000:0.0:1787604056.535760:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 67: rc = 0 00100000:10000000:0.0:1787604056.536061:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 67: rc = 0 00100000:10000000:0.0:1787604056.536653:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 67: rc = 0 00100000:10000000:0.0:1787604056.536955:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 67: rc = 0 00100000:10000000:0.0:1787604056.537204:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 67: rc = 0 00100000:10000000:0.0:1787604056.537458:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 67: rc = 0 00100000:10000000:0.0:1787604056.537696:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 67: rc = 0 00100000:10000000:0.0:1787604056.537964:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 67: rc = 0 00100000:10000000:0.0:1787604056.538338:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 62: rc = 0 00100000:10000000:0.0:1787604056.538808:0:14333:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1787604056.539022:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 591: rc = 0 00100000:10000000:0.0:1787604056.539202:0:14333:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1787604056.539267:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 591: rc = 0 00100000:10000000:0.0:1787604056.539444:0:14333:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1787604056.539503:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 591: rc = 0 00100000:10000000:0.0:1787604056.539827:0:14333:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1787604056.539930:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 58: rc = 0 00100000:10000000:0.0:1787604056.542102:0:14333:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1787604056.542186:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 58: rc = 0 00100000:10000000:0.0:1787604056.542389:0:14333:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1787604056.542454:0:14333:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 58: rc = 0 00000020:00000080:0.0:1787604056.542717:0:14333:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787604056.542797:0:14333:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787604056.542809:0:14333:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a1902414 00000020:01000004:0.0:1787604056.542818:0:14333:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787604056.542832:0:14333:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787604056.542988:0:14333:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ed283965800 from MGS 00000020:01000004:0.0:1787604056.543000:0:14333:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787604056.543009:0:14333:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ed2b6133370) 00000020:00000080:0.0:1787604056.543020:0:14333:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787604056.543074:0:14333:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ed283965800 from MGS, refs=2 00080000:01000000:0.0:1787604056.543080:0:14333:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787604056.543087:0:14333:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a1902422 00000100:00100000:0.0:1787604056.543180:0:14333:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787604056.543303:0:14333:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787604056.543309:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787604056.543694:0:14333:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787604056.543700:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787604056.544612:0:14333:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787604056.545096:0:14333:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787604056.545103:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787604056.545508:0:14333:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787604056.545516:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787604056.546068:0:14333:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787604056.546076:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787604056.546553:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604056.546556:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604056.546558:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604056.546879:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604056.546882:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604056.546883:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604056.547335:0:14333:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787604056.551962:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787604056.556712:0:14333:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787604056.556807:0:14333:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787604056.556811:0:14333:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787604056.558514:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787604056.558653:0:14333:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787604056.558826:0:14333:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787604056.559381:0:14333:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787604056.559671:0:14333:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787604056.561003:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787604056.561014:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787604056.567556:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787604056.567569:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787604056.568118:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787604056.568124:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787604056.568808:0:14333:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787604056.568832:0:14333:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.121@tcp' 00000020:01000004:0.0:1787604056.568936:0:14333:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787604056.568966:0:14333:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.121@tcp (typ=mgc) 00000020:00000080:0.0:1787604056.568975:0:14333:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.121@tcp (ffff9ed2b6130000) 00000020:00000080:0.0:1787604056.568987:0:14333:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1787604056.569074:0:14348:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1787604056.569082:0:14333:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ed286a70000@MGC192.168.202.121@tcp: add connection 192.168.202.121@tcp at head 00010000:00010000:0.0:1787604056.569209:0:14333:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.121@tcp-0 is initialized 00000040:01000000:0.0:1787604056.569214:0:14333:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.121@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787604056.571186:0:14349:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787604056.571267:0:14333:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.121@tcp (uuid 8e30912c-ffd9-4190-a569-23df3a025820) 00000020:00000080:1.0:1787604056.571287:0:14333:0:(genops.c:1385:class_connect()) connect: client 8e30912c-ffd9-4190-a569-23df3a025820, cookie 0xb5d1f3b1a1902430 00000100:00080000:1.0:1787604056.571299:0:14333:0:(import.c:510:import_select_connection()) MGC192.168.202.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787604056.571305:0:14333:0:(import.c:624:import_select_connection()) MGC192.168.202.121@tcp: import ffff9ed286a70000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:1.0:1787604056.571339:0:14333:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2b4e0e300 x1874438355241984/t0(0) o250->MGC192.168.202.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604056.571411:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e30912c-ffd9-4190-a569-23df3a025820:3280:1874438355241984:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787604056.571480:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787604056.571737:0:14333:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8e30912c-ffd9-4190-a569-23df3a025820->MGS 00000020:01000004:1.0:1787604056.571765:0:14333:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787604056.571770:0:14333:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787604056.571783:0:14333:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ed2bf080000) 00000020:00000080:1.0:1787604056.571794:0:14333:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787604056.577579:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355241984 00000100:00100000:0.0:1787604056.577591:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355241984 00000100:00100000:0.0:1787604056.577627:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787604056.577636:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3280:x1874438355241984:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787604056.577661:0:14345:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8e30912c-ffd9-4190-a569-23df3a025820@0@lo t0 exp 0000000000000000 cur 389 last 0 00000020:00000080:0.0:1787604056.577690:0:14345:0:(genops.c:1385:class_connect()) connect: client 8e30912c-ffd9-4190-a569-23df3a025820, cookie 0xb5d1f3b1a190243e 00000100:00080000:0.0:1787604056.577903:0:14345:0:(import.c:65:import_set_state_nolock()) ffff9ed286a77800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787604056.577987:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+5:3280:x1874438355241984:12345-0@lo:250:mount.lustre.0 Request processed in 350us (6505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604056.578010:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787604056.578061:0:3280:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787604056.578071:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.121@tcp: connect to target with instance 0 00000100:00080000:0.0:1787604056.578078:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787604056.578083:0:3280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787604056.578087:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed286a70000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787604056.578089:0:3280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787604056.578098:0:3280:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787604056.578103:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e30912c-ffd9-4190-a569-23df3a025820:3280:1874438355241984:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787604056.583096:0:14333:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787604056.583294:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787604056.583299:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787604056.583696:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787604056.583703:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787604056.584113:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787604056.584119:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787604056.584565:0:14333:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787604056.584686:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787604056.584690:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787604056.585268:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787604056.585275:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787604056.628729:0:14333:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787604056.629114:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787604056.629120:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787604056.637167:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787604056.639396:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787604056.640091:0:14333:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787604056.640266:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787604056.640272:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787604056.640746:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787604056.640753:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787604056.641327:0:14333:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787604056.641472:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787604056.641477:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787604056.642044:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787604056.642050:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787604056.642523:0:14333:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787604056.642672:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787604056.642677:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787604056.643254:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787604056.643260:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787604056.664394:0:14333:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787604056.664570:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787604056.664577:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787604056.669887:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787604056.669904:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787604056.672449:0:14333:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787604056.672461:0:14333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787604056.673266:0:14333:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787604056.673296:0:14333:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787604056.673304:0:14333:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787604056.673435:0:14333:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787604056.673466:0:14333:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.121@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787604056.673471:0:14333:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787604056.673472:0:14333:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787604056.673474:0:14333:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787604056.673475:0:14333:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787604056.673477:0:14333:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787604056.673478:0:14333:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787604056.673480:0:14333:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787604056.673481:0:14333:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787604056.673483:0:14333:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787604056.673484:0:14333:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787604056.673487:0:14333:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787604056.673489:0:14333:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787604056.673490:0:14333:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787604056.673491:0:14333:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787604056.673496:0:14333:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787604056.673497:0:14333:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787604056.673498:0:14333:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787604056.673499:0:14333:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787604056.673500:0:14333:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787604056.673501:0:14333:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787604056.673502:0:14333:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787604056.673525:0:14333:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787604056.673547:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242112:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787604056.673620:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604056.673669:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed288b9b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787604056.673833:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355242112 00000100:00100000:3.0:1787604056.673867:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355242112 00000100:00100000:3.0:1787604056.673916:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787604056.673936:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+5:14333:x1874438355242112:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787604056.673988:0:14347:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787604056.674003:0:14347:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787604056.674006:0:14347:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787604056.674295:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787604056.674619:0:14347:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787604056.675649:0:14369:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787604056.675655:0:14369:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787604056.675658:0:14369:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787604056.675691:0:14369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787604056.676155:0:14347:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787604056.676170:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787604056.680369:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+5:14333:x1874438355242112:12345-0@lo:253:mount.lustre.0 Request processed in 6427us (6739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604056.680383:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787604056.680484:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242112:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787604056.680500:0:14333:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787604056.680503:0:14333:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787604056.680505:0:14333:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787604056.680506:0:14333:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787604056.680507:0:14333:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787604056.680509:0:14333:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787604056.680510:0:14333:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787604056.680511:0:14333:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787604056.680513:0:14333:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787604056.680515:0:14333:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787604056.680516:0:14333:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787604056.680534:0:14333:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ed283965800 from lustre-MDT0000 10000000:01000000:1.0:1787604056.680559:0:14333:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787604056.680562:0:14333:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787604056.680566:0:14333:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ed2b6130000 10000000:01000000:1.0:1787604056.680570:0:14333:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787604056.680577:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ed2b6130000 from 1 10000000:01000000:1.0:1787604056.680580:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787604056.680614:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604056.680625:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604056.680653:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604056.680671:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787604056.680706:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604056.680831:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc27840 going to sleep for 11 seconds 00000100:00100000:1.0:1787604056.681254:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355242240 00000100:00100000:1.0:1787604056.681262:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355242240 00000100:00100000:1.0:1787604056.681341:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787604056.681351:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+5:14333:x1874438355242240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787604056.681363:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604056.681379:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2bec7fe00/0xb5d1f3b1a190244c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1902445 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604056.681402:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2bec7fe00/0xb5d1f3b1a190244c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902445 expref: 6 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604056.681413:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2bec7fe00/0xb5d1f3b1a190244c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902445 expref: 6 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604056.681422:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7fe00, rc 0) 00000100:00100000:1.0:1787604056.681464:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+6:14333:x1874438355242240:12345-0@lo:101:mount.lustre.0 Request processed in 114us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604056.681470:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787604056.681531:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604056.681545:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190244c expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.681553:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190244c expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604056.681599:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604056.681625:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.681717:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295142300 going to sleep for 11 seconds 00000100:00100000:0.0:1787604056.681963:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355242368 00000100:00100000:0.0:1787604056.681967:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355242368 00000100:00100000:0.0:1787604056.682003:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787604056.682010:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+6:14333:x1874438355242368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604056.682232:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+6:14333:x1874438355242368:12345-0@lo:501:mount.lustre.0 Request processed in 221us (605us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787604056.682239:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787604056.682307:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242368:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787604056.682331:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787604056.682349:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190244c expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.682358:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190244c expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604056.682365:0:14333:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ed283965800 10000000:01000000:3.0:1787604056.682376:0:14333:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787604056.682381:0:14333:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ed283965800 10000000:01000000:3.0:1787604056.682383:0:14333:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787604056.682386:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ed283965800 from 1 10000000:01000000:3.0:1787604056.682388:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787604056.682408:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1902453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.682417:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1902453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.682424:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1902453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604056.682436:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787604056.682464:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.682483:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295142300 going to sleep for 11 seconds 00000100:00100000:0.0:1787604056.682589:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355242496 00000100:00100000:0.0:1787604056.682593:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355242496 00000100:00100000:0.0:1787604056.682611:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787604056.682616:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+6:14333:x1874438355242496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604056.682623:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604056.682634:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298595c00/0xb5d1f3b1a190245a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1902453 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604056.682646:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298595c00/0xb5d1f3b1a190245a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902453 expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604056.682654:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298595c00/0xb5d1f3b1a190245a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902453 expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604056.682661:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595c00, rc 0) 00000100:00100000:0.0:1787604056.682694:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+7:14333:x1874438355242496:12345-0@lo:101:mount.lustre.0 Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604056.682700:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787604056.682781:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604056.682792:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1902453 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190245a expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.682800:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1902453 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190245a expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604056.682810:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787604056.682821:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1902453 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190245a expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.682828:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac400/0xb5d1f3b1a1902453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190245a expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604056.682888:0:14333:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787604056.682892:0:14333:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787604056.682897:0:14333:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ed283965800 10000000:01000000:3.0:1787604056.682899:0:14333:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787604056.682902:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787604056.682904:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787604056.682916:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac600/0xb5d1f3b1a1902461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.682923:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac600/0xb5d1f3b1a1902461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.682930:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac600/0xb5d1f3b1a1902461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604056.682942:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787604056.682968:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.682983:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295142300 going to sleep for 11 seconds 00000100:00100000:0.0:1787604056.683133:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355242624 00000100:00100000:0.0:1787604056.683138:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355242624 00000100:00100000:0.0:1787604056.683157:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787604056.683163:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+7:14333:x1874438355242624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604056.683170:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604056.683178:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298595000/0xb5d1f3b1a1902468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1902461 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604056.683192:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298595000/0xb5d1f3b1a1902468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902461 expref: 8 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604056.683200:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298595000/0xb5d1f3b1a1902468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902461 expref: 8 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604056.683207:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595000, rc 0) 00000100:00100000:0.0:1787604056.686526:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+8:14333:x1874438355242624:12345-0@lo:101:mount.lustre.0 Request processed in 3353us (3548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604056.686538:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787604056.686853:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604056.686878:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac600/0xb5d1f3b1a1902461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902468 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.686891:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac600/0xb5d1f3b1a1902461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1902468 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604056.686959:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604056.687020:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.687070:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295142300 going to sleep for 11 seconds 00000100:00100000:1.0:1787604056.687170:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355242752 00000100:00100000:1.0:1787604056.687176:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355242752 00000100:00100000:1.0:1787604056.687254:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787604056.687264:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+8:14333:x1874438355242752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604056.687631:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+9:14333:x1874438355242752:12345-0@lo:501:mount.lustre.0 Request processed in 368us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604056.687640:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787604056.687700:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604056.687739:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787604056.687777:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.688173:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295142300 going to sleep for 11 seconds 00000100:00100000:0.0:1787604056.688207:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355242880 00000100:00100000:0.0:1787604056.688212:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355242880 00000100:00100000:0.0:1787604056.688238:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787604056.688245:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+9:14333:x1874438355242880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604056.688550:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+9:14333:x1874438355242880:12345-0@lo:503:mount.lustre.0 Request processed in 304us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604056.688557:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787604056.688714:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355242880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787604056.689204:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e30912c-ffd9-4190-a569-23df3a025820:14370:1874438355243008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787604056.689251:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.689285:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2951423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604056.689325:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355243008 00000100:00100000:0.0:1787604056.689330:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355243008 00000100:00100000:0.0:1787604056.689364:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787604056.689372:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+9:14370:x1874438355243008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787604056.689659:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+9:14370:x1874438355243008:12345-0@lo:502:llog_process_th.0 Request processed in 287us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604056.689665:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787604056.689949:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e30912c-ffd9-4190-a569-23df3a025820:14370:1874438355243008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787604056.689972:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787604056.689982:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604056.689985:0:14370:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787604056.689999:0:14370:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787604056.690003:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787604056.690018:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ed2ba1e8000) 00000020:00000080:3.0:1787604056.690035:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787604056.690041:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787604056.690112:0:14370:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787604056.690120:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a1902476 00000020:00000080:3.0:1787604056.690331:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787604056.690335:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787604056.690339:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604056.690341:0:14370:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787604056.690344:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787604056.690347:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604056.690348:0:14370:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787604056.690352:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787604056.690365:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ed2ba1e99b8) 00000020:00000080:3.0:1787604056.690375:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787604056.690379:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787604056.690381:0:14370:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787604056.690384:0:14370:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787604056.690389:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787604056.690437:0:14370:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ed283965800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787604056.690450:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ed2ba1ecd28) 00000020:00000080:3.0:1787604056.690457:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787604056.690497:0:14370:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787604056.690502:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb5d1f3b1a190248b 00000020:00000080:3.0:1787604056.690588:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787604056.690594:0:14370:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787604056.690599:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb5d1f3b1a1902492 00080000:01000000:3.0:1787604056.690603:0:14370:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787604056.690606:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a1902499 00010000:00010000:3.0:1787604056.743189:0:14370:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787604056.743606:0:14370:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787604056.743782:0:14370:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787604056.745010:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ed2b9ee99b8) 00000020:00000080:2.0:1787604056.745028:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787604056.745108:0:14370:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787604056.745116:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a19024a7 00000020:00000080:3.0:1787604056.745507:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787604056.751227:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb5d1f3b1a19024ae 00000020:00000080:2.0:1787604056.755031:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787604056.755046:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604056.755053:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.755055:0:14370:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787604056.755058:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787604056.755065:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.755067:0:14370:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787604056.755072:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787604056.755120:0:14370:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787604056.755136:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604056.755140:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.755141:0:14370:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787604056.755143:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787604056.755145:0:14370:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1787604056.755154:0:14370:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787604056.755156:0:14370:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787604056.755157:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787604056.755160:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.755161:0:14370:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787604056.755164:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787604056.755167:0:14370:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787604056.755170:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.755171:0:14370:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787604056.755174:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787604056.755180:0:14370:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.121@tcp to nid 0x20000c0a8ca79 (192.168.202.121@tcp) 00000020:01000000:2.0:1787604056.755207:0:14370:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787604056.755211:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787604056.755226:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ed2b9eecd28) 00000020:00000080:2.0:1787604056.755242:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787604056.755249:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787604056.755306:0:14370:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787604056.755311:0:14370:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787604056.755318:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a19024bc 00010000:00080000:2.0:1787604056.755351:0:14370:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ed287c4e000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.121@tcp at head 00010000:00010000:2.0:1787604056.755585:0:14370:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787604056.756108:0:14370:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787604056.756152:0:14370:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787604056.757949:0:14370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787604056.758025:0:14370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787604056.758111:0:14370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787604056.758588:0:14374:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787604056.758593:0:14374:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787604056.759260:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787604056.759271:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787604056.759303:0:14370:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787604056.759320:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb5d1f3b1a19024c3 00000100:00080000:2.0:1787604056.759334:0:14370:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787604056.759340:0:14370:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ed287c4e000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:2.0:1787604056.759372:0:14370:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2c1ec6a00 x1874438355243136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604056.759436:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355243136:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787604056.759487:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438355243136 offset 0 length 520: 4 00000100:00080000:2.0:1787604056.759542:0:14370:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787604056.759604:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604056.759609:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.759611:0:14370:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787604056.759614:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787604056.759617:0:14370:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1787604056.759619:0:14370:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787604056.759620:0:14370:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787604056.759622:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787604056.759625:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.759626:0:14370:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787604056.759628:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787604056.759632:0:14370:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787604056.759636:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.759638:0:14370:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787604056.759640:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787604056.759644:0:14370:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.121@tcp to nid 0x20000c0a8ca79 (192.168.202.121@tcp) 00000020:01000000:2.0:1787604056.759662:0:14370:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787604056.759664:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787604056.759675:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ed2b9eeb370) 00000020:00000080:2.0:1787604056.759688:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787604056.759692:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787604056.759755:0:14370:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787604056.759761:0:14370:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787604056.759766:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb5d1f3b1a19024d1 00010000:00080000:2.0:1787604056.759791:0:14370:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ed1835bb000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.121@tcp at head 00010000:00010000:2.0:1787604056.760026:0:14370:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787604056.760176:0:14370:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787604056.760196:0:14370:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787604056.760575:0:14370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787604056.760639:0:14370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787604056.760711:0:14370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787604056.762083:0:14376:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787604056.762089:0:14376:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787604056.763309:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787604056.763321:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787604056.763352:0:14370:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787604056.763372:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb5d1f3b1a19024d8 00000100:00080000:2.0:1787604056.763382:0:14370:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787604056.763388:0:14370:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ed1835bb000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:2.0:1787604056.763424:0:14370:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2c1ec7800 x1874438355243264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604056.763480:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355243264:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787604056.763548:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438355243264 offset 0 length 520: 4 00000100:00080000:2.0:1787604056.763598:0:14370:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787604056.763685:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604056.763689:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.763691:0:14370:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787604056.763695:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787604056.763698:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.763700:0:14370:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787604056.763702:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787604056.763704:0:14370:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787604056.763706:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604056.763708:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.763710:0:14370:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787604056.763712:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787604056.763714:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.763715:0:14370:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787604056.764016:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787604056.764049:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e30912c-ffd9-4190-a569-23df3a025820:14370:1874438355243392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787604056.764112:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604056.764142:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28b66e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787604056.764208:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355243392 00000100:00100000:3.0:1787604056.764215:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355243392 00000100:00100000:3.0:1787604056.764263:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787604056.764274:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+9:14370:x1874438355243392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787604056.764500:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+9:14370:x1874438355243392:12345-0@lo:502:llog_process_th.0 Request processed in 228us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604056.764508:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787604056.764607:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e30912c-ffd9-4190-a569-23df3a025820:14370:1874438355243392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787604056.764633:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604056.764638:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604056.764639:0:14370:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787604056.764643:0:14370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787604056.764867:0:14333:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787604056.764883:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787604056.764899:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac600/0xb5d1f3b1a1902461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902468 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.764915:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dac600/0xb5d1f3b1a1902461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902468 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604056.764924:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ed283965800 from 1 10000000:01000000:3.0:1787604056.764927:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787604056.764950:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.764957:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.764968:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604056.764981:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355243520:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787604056.765025:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.765050:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2a122f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604056.765117:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355243520 00000100:00100000:2.0:1787604056.765121:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355243520 00000100:00100000:2.0:1787604056.765144:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787604056.765151:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+9:14333:x1874438355243520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604056.765159:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604056.765174:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19024e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19024df expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.765194:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19024e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19024df expref: 10 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.765203:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19024e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19024df expref: 10 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.765211:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963c00, rc 0) 00000100:00100000:2.0:1787604056.765239:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+10:14333:x1874438355243520:12345-0@lo:101:mount.lustre.0 Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604056.765245:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787604056.765310:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355243520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604056.765323:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19024e6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.765331:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19024e6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604056.765823:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355243648:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787604056.765915:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.765932:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2a122f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604056.766073:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355243648 00000100:00100000:2.0:1787604056.766078:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355243648 00000100:00100000:2.0:1787604056.766102:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787604056.766109:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+10:14333:x1874438355243648:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787604056.766127:0:14347:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787604056.766133:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787604056.766186:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+10:14333:x1874438355243648:12345-0@lo:256:mount.lustre.0 Request processed in 77us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604056.766193:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787604056.766371:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355243648:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787604056.767196:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787604056.767216:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19024e6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.767227:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19024e6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604056.767485:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed283965800 from 1 10000000:01000000:2.0:1787604056.767489:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787604056.767518:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.767526:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.767535:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604056.767550:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355243776:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787604056.767590:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604056.767621:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed283e90600 going to sleep for 11 seconds 00000100:00100000:3.0:1787604056.767706:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355243776 00000100:00100000:3.0:1787604056.767711:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355243776 00000100:00100000:3.0:1787604056.767816:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787604056.767825:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+10:14333:x1874438355243776:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604056.767859:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604056.767873:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dac000/0xb5d1f3b1a19024f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19024ed expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.767892:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dac000/0xb5d1f3b1a19024f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19024ed expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.767901:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b5dac000/0xb5d1f3b1a19024f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19024ed expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.767909:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dac000, rc 0) 00000100:00100000:3.0:1787604056.767947:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+11:14333:x1874438355243776:12345-0@lo:101:mount.lustre.0 Request processed in 123us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604056.767954:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787604056.768104:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355243776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604056.768118:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19024f4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604056.768126:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19024f4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604056.768175:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355243904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604056.768202:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604056.768229:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc08a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787604056.768299:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355243904 00000100:00100000:2.0:1787604056.768303:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355243904 00000100:00100000:2.0:1787604056.768331:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787604056.768338:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+11:14333:x1874438355243904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604056.768695:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+11:14333:x1874438355243904:12345-0@lo:501:mount.lustre.0 Request processed in 356us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604056.768702:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787604056.768870:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355243904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604056.768900:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355244032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604056.768938:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604056.768961:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc08a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787604056.769043:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355244032 00000100:00100000:3.0:1787604056.769048:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355244032 00000100:00100000:2.0:1787604056.769217:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787604056.769227:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+11:14333:x1874438355244032:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787604056.769386:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+11:14333:x1874438355244032:12345-0@lo:503:mount.lustre.0 Request processed in 161us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604056.769393:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787604056.769464:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355244032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787604056.770944:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e30912c-ffd9-4190-a569-23df3a025820:14378:1874438355244160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787604056.771032:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.771106:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295245180 going to sleep for 11 seconds 00000100:00100000:0.0:1787604056.771197:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355244160 00000100:00100000:0.0:1787604056.771208:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355244160 00000100:00100000:0.0:1787604056.771278:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787604056.771288:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+11:14378:x1874438355244160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787604056.771532:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+11:14378:x1874438355244160:12345-0@lo:502:llog_process_th.0 Request processed in 245us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604056.771539:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787604056.771611:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e30912c-ffd9-4190-a569-23df3a025820:14378:1874438355244160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787604056.771637:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787604056.771647:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604056.771649:0:14378:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787604056.771657:0:14378:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ed283965800 00000020:00000080:3.0:1787604056.771660:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787604056.771668:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787604056.771671:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604056.771672:0:14378:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787604056.771675:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787604056.771677:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604056.771678:0:14378:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787604056.771681:0:14378:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ed283965800 00000020:00000080:3.0:1787604056.771684:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787604056.771752:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787604056.771756:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604056.771757:0:14378:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787604056.771760:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787604056.771763:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604056.771764:0:14378:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787604056.771767:0:14378:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ed283965800 00000020:00000080:3.0:1787604056.771770:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787604056.771804:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e30912c-ffd9-4190-a569-23df3a025820:14378:1874438355244288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787604056.771859:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.775232:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295245180 going to sleep for 11 seconds 00000100:00100000:2.0:1787604056.775271:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355244288 00000100:00100000:2.0:1787604056.775279:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355244288 00000100:00100000:2.0:1787604056.775321:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787604056.775331:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+11:14378:x1874438355244288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787604056.775598:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+11:14378:x1874438355244288:12345-0@lo:502:llog_process_th.0 Request processed in 268us (3738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604056.775607:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787604056.780481:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e30912c-ffd9-4190-a569-23df3a025820:14378:1874438355244288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787604056.780548:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787604056.780562:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604056.780565:0:14378:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787604056.780570:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787604056.785885:0:14333:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787604056.785924:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787604056.785949:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19024f4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.785962:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19024f4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604056.786026:0:14333:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787604056.786029:0:14333:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ed283965800 10000000:01000000:2.0:1787604056.786031:0:14333:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ed283965800 10000000:01000000:2.0:1787604056.786035:0:14333:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787604056.786040:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ed283965800 from 1 10000000:01000000:2.0:1787604056.786043:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787604056.786078:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962400/0xb5d1f3b1a19024fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.786086:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962400/0xb5d1f3b1a19024fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.786104:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962400/0xb5d1f3b1a19024fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604056.786127:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355244416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787604056.786192:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604056.786228:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2984fd540 going to sleep for 11 seconds 00000100:00100000:2.0:1787604056.786257:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355244416 00000100:00100000:2.0:1787604056.786264:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355244416 00000100:00100000:2.0:1787604056.786304:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787604056.786313:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+11:14333:x1874438355244416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604056.786324:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604056.786337:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1902502 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19024fb expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.786360:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1902502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19024fb expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.786371:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b4962a00/0xb5d1f3b1a1902502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19024fb expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.786380:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962a00, rc 0) 00000100:00100000:2.0:1787604056.786418:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+12:14333:x1874438355244416:12345-0@lo:101:mount.lustre.0 Request processed in 106us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604056.786424:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787604056.786470:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355244416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604056.786484:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962400/0xb5d1f3b1a19024fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902502 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.786499:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962400/0xb5d1f3b1a19024fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1902502 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604056.786543:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355244544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604056.786568:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604056.786594:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2984fd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787604056.786686:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355244544 00000100:00100000:0.0:1787604056.786690:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355244544 00000100:00100000:0.0:1787604056.786791:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787604056.786799:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+12:14333:x1874438355244544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604056.788015:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+12:14333:x1874438355244544:12345-0@lo:501:mount.lustre.0 Request processed in 1213us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604056.788026:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787604056.788205:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355244544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604056.788244:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355244672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787604056.788288:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604056.788315:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355244672 00000100:00100000:2.0:1787604056.788319:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355244672 00000100:00100000:2.0:1787604056.788349:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787604056.788356:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+12:14333:x1874438355244672:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787604056.788502:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+12:14333:x1874438355244672:12345-0@lo:503:mount.lustre.0 Request processed in 145us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604056.788508:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787604056.788550:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2984fd540 going to sleep for 11 seconds 00000100:00100000:2.0:1787604056.788562:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355244672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604056.790049:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e30912c-ffd9-4190-a569-23df3a025820:14383:1874438355244800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787604056.790105:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604056.790146:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bfc086c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787604056.790242:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355244800 00000100:00100000:1.0:1787604056.790249:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355244800 00000100:00100000:1.0:1787604056.790288:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787604056.790297:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+12:14383:x1874438355244800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787604056.790515:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+12:14383:x1874438355244800:12345-0@lo:502:llog_process_th.0 Request processed in 218us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604056.790523:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787604056.790622:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e30912c-ffd9-4190-a569-23df3a025820:14383:1874438355244800:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787604056.790679:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787604056.790693:0:14383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ed2b61319b8) 00000020:00000080:0.0:1787604056.790713:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787604056.790921:0:14383:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ed283965800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787604056.790926:0:14383:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ed283965800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787604056.790929:0:14383:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ed283965800 4 00010000:00080000:0.0:1787604056.790958:0:14383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ed2ba24b000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.121@tcp at head 00010000:00010000:3.0:1787604056.801375:0:14383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787604056.801578:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787604056.801614:0:14383:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787604056.801627:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb5d1f3b1a1902510 00000100:00080000:3.0:1787604056.801637:0:14383:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787604056.801643:0:14383:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ed2ba24b000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:3.0:1787604056.801677:0:14383:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2bf6d8380 x1874438355244928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787604056.801702:0:14383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787604056.802603:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e30912c-ffd9-4190-a569-23df3a025820:14383:1874438355245056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787604056.802680:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.802717:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295245840 going to sleep for 11 seconds 00000100:00100000:0.0:1787604056.803876:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874438355244928:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787604056.803933:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604056.804874:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355244928 00000100:00100000:1.0:1787604056.804885:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355244928 00000100:00100000:1.0:1787604056.804932:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787604056.804941:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874438355244928:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787604056.805040:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874438355244928:12345-0@lo:38:llog_process_th.0 Request processed in 99us (1106us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787604056.805049:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787604056.805538:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787604056.805547:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2ba24b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787604056.805552:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787604056.805555:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874438355244928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787604056.806273:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355245056 00000100:00100000:2.0:1787604056.806280:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355245056 00000100:00100000:2.0:1787604056.806320:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787604056.806329:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+12:14383:x1874438355245056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787604056.806592:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+12:14383:x1874438355245056:12345-0@lo:502:llog_process_th.0 Request processed in 262us (3910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604056.806609:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787604056.806663:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e30912c-ffd9-4190-a569-23df3a025820:14383:1874438355245056:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787604056.806695:0:14383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787604056.806818:0:14333:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787604056.806857:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787604056.806871:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962400/0xb5d1f3b1a19024fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902502 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604056.806882:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962400/0xb5d1f3b1a19024fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902502 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787604056.806924:0:14333:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787604056.806926:0:14333:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787604056.806928:0:14333:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604056.806929:0:14333:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604056.806930:0:14333:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604056.806931:0:14333:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604056.806932:0:14333:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787604056.806934:0:14333:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787604056.806936:0:14333:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604056.806937:0:14333:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787604056.806941:0:14333:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787604056.806943:0:14333:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787604056.806944:0:14333:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787604056.806945:0:14333:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604056.806946:0:14333:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604056.806947:0:14333:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604056.806948:0:14333:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604056.806950:0:14333:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787604056.806951:0:14333:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787604056.806952:0:14333:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604056.806953:0:14333:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787604056.806969:0:14333:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787604056.806984:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355245184:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787604056.807037:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604056.807063:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2984fd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787604056.807082:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355245184 00000100:00100000:2.0:1787604056.807086:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355245184 00000100:00100000:2.0:1787604056.807108:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787604056.807114:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+12:14333:x1874438355245184:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787604056.807142:0:14347:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787604056.807155:0:14347:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787604056.840120:0:14347:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787604056.840140:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787604056.840260:0:14368:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787604056.840265:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787604056.840289:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.840307:0:14368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19024e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19024df expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.840316:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.840359:0:14368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19024e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19024df expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.840373:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19024e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19024df expref: 12 pid: 14346 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604056.840404:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6da680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14368:1874438355245312:0@lo:104: 00000100:00100000:3.0:1787604056.840473:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.840518:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295245f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787604056.840665:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355245312 00000100:00100000:1.0:1787604056.840674:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355245312 00000100:00100000:1.0:1787604056.840735:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787604056.840746:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e30912c-ffd9-4190-a569-23df3a025820+3:14368:x1874438355245312:12345-0@lo:104: 00010000:00010000:1.0:1787604056.840759:0:14335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19024e6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604056.840814:0:14335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787604056.840820:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e30912c-ffd9-4190-a569-23df3a025820+3:14368:x1874438355245312:12345-0@lo:104: Request processed in 76us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604056.840864:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787604056.841060:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604056.841067:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19024e6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841075:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dadc00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787604056.841078:0:14341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19024e6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841086:0:14341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19024e6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604056.841093:0:14341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19024e6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604056.841099:0:14341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787604056.841133:0:14341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19024e6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841139:0:14341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787604056.841160:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19024e6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841168:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dadc00/0xb5d1f3b1a19024df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19024e6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841184:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604056.841191:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604056.841193:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604056.841212:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787604056.841222:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e30912c-ffd9-4190-a569-23df3a025820:3284:1874438355245440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604056.841253:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604056.841297:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355245440 00000100:00100000:3.0:1787604056.841301:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355245440 00010000:00010000:3.0:1787604056.841319:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19024e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19024df expref: 13 pid: 14346 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604056.841340:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787604056.841347:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e30912c-ffd9-4190-a569-23df3a025820+13:3284:x1874438355245440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787604056.841358:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604056.841363:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19024e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19024df expref: 13 pid: 14346 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841374:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19024e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19024df expref: 13 pid: 14346 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841390:0:14337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841399:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787604056.841410:0:14337:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001145872s 00010000:00010000:3.0:1787604056.841414:0:14337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841422:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841440:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841447:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841452:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dade00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604056.841456:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841464:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841472:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841482:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787604056.841510:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e30912c-ffd9-4190-a569-23df3a025820+13:3284:x1874438355245440:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604056.841516:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787604056.841553:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e30912c-ffd9-4190-a569-23df3a025820:3284:1874438355245440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787604056.841580:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19024e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19024df expref: 12 pid: 14346 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604056.841590:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6da680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14368:1874438355245312:0@lo:104: 00010000:00010000:3.0:1787604056.841601:0:14368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841618:0:14368:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841624:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604056.841630:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5dade00/0xb5d1f3b1a1902517 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604056.848275:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+11:14333:x1874438355245184:12345-0@lo:253:mount.lustre.0 Request processed in 41149us (41227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604056.848291:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787604056.848597:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:14333:1874438355245184:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787604056.848612:0:14333:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787604056.848616:0:14333:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787604056.848618:0:14333:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787604056.848619:0:14333:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604056.848620:0:14333:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604056.848621:0:14333:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604056.848623:0:14333:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604056.848624:0:14333:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787604056.848626:0:14333:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787604056.848627:0:14333:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604056.848628:0:14333:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787604056.848645:0:14333:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787604056.852518:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787604056.852678:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787604056.852975:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787604056.853171:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787604056.853419:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787604056.853561:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787604056.854432:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787604056.854590:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787604056.857387:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787604056.857635:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787604056.858088:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787604056.858241:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787604056.876539:0:14333:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787604056.876852:0:14333:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787604056.877256:0:14390:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787604056.877322:0:14390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787604056.883306:0:14333:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787604056.883435:0:14333:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787604056.883896:0:14333:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787604056.883903:0:14333:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:3.0:1787604056.884152:0:14389:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787604056.884157:0:14389:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1787604056.884305:0:14333:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787604056.886401:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787604056.886482:0:14390:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787604056.886487:0:14390:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1787604056.887224:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787604056.887912:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787604056.887949:0:14333:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787604056.888424:0:14333:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1787604056.889618:0:14333:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787604056.896392:0:14333:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787604056.923948:0:14333:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787604056.923986:0:14333:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb261414fb988 00100000:10000000:1.0:1787604056.924005:0:14333:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787604056.924749:0:14333:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787604056.924765:0:14333:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.121@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787604056.924778:0:14333:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1787604056.924804:0:14333:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787604057.559400:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787604057.818506:0:14384:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787604057.818519:0:14384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787604057.818973:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1787604057.818994:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1787604058.135918:0:14349:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787604058.135930:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ed283965800 from 6 10000000:01000000:2.0:1787604058.135937:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787604058.136015:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604058.136030:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604058.136052:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604058.136188:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355245568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787604058.136289:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604058.136358:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295151d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787604058.136383:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355245568 00000100:00100000:1.0:1787604058.136396:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355245568 00000100:00100000:1.0:1787604058.136463:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787604058.136476:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+11:14349:x1874438355245568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787604058.136493:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604058.136510:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190251e expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604058.136540:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190251e expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604058.136552:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190251e expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604058.136563:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7ec00, rc 0) 00000100:00100000:1.0:1787604058.136794:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+12:14349:x1874438355245568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 320us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604058.136802:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787604058.136803:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355245568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787604058.136819:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902525 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604058.136864:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1902525 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604058.136924:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355245696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787604058.136962:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604058.137004:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295151d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787604058.137009:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355245696 00000100:00100000:0.0:1787604058.137014:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355245696 00000100:00100000:0.0:1787604058.137053:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787604058.137061:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+12:14349:x1874438355245696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787604058.137078:0:14347:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787604058.137100:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787604058.137104:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787604058.137219:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+12:14349:x1874438355245696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604058.137224:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787604058.137509:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355245696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787604058.137570:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787604058.137578:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902525 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604058.137587:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902525 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604058.584013:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787604058.839709:0:14384:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787604058.839720:0:14384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787604058.839761:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1787604058.839770:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787604059.607021:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604060.638591:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787604060.978229:0:14632:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787604061.660904:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787604062.167108:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604062.167115:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787604062.167139:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604062.167143:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787604062.167146:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787604062.167156:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787604062.167160:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ed2ba24b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787604062.167173:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ed2ba24b000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:0.0:1787604062.167197:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2b9df6680 x1874438355245952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604062.167232:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874438355245952:0@lo:38:kworker.0 00000100:00100000:0.0:1787604062.167321:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604062.167445:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e30912c-ffd9-4190-a569-23df3a025820:3284:1874438355245824:0@lo:400:kworker.0 00000100:00100000:1.0:1787604062.167486:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604062.167543:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355245952 00000100:00100000:1.0:1787604062.167550:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355245952 00000100:00100000:1.0:1787604062.167583:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787604062.167591:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3280:x1874438355245952:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787604062.167618:0:14354:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:1.0:1787604062.167657:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb5d1f3b1a190252c 00000004:00100000:1.0:1787604062.167688:0:14354:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787604062.167857:0:14354:0:(import.c:65:import_set_state_nolock()) ffff9ed2c1b44800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787604062.167908:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874438355245952:12345-0@lo:38:kworker.0 Request processed in 316us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604062.167926:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787604062.168098:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355245824 00000100:00100000:0.0:1787604062.168104:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355245824 00000100:00100000:0.0:1787604062.168147:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787604062.168155:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+12:3284:x1874438355245824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604062.168200:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+12:3284:x1874438355245824:12345-0@lo:400:kworker.0 Request processed in 46us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604062.168208:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787604062.168238:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e30912c-ffd9-4190-a569-23df3a025820:3284:1874438355245824:0@lo:400:kworker.0 00010000:00080000:0.0:1787604062.168256:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ed2b9df6680 x1874438355245952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787604072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787604062.168271:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787604062.168278:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787604062.168282:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787604062.168284:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2ba24b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787604062.168290:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874438355245952:0@lo:38:kworker.0 00010000:00010000:1.0:1787604062.682375:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604063.708420:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787604063.852521:0:14783:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6b764a20 20000000:00000080:2.0:1787604063.852540:0:14783:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ed2b65e1400 uarg=0000000000000000 20000000:01000000:2.0:1787604063.852573:0:14783:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787604063.852580:0:14783:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787604063.852584:0:14783:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787604063.853406:0:14784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787604063.853562:0:14783:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787604063.863255:0:14783:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787604063.863293:0:14783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604063.863315:0:14783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b5dac000/0xb5d1f3b1a19024f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19024ed expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604063.863323:0:14783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604063.863371:0:14783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b5dac000/0xb5d1f3b1a19024f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19024ed expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604063.863388:0:14783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2b5dac000/0xb5d1f3b1a19024f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19024ed expref: 11 pid: 14345 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604063.863423:0:14783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14783:1874438355246080:0@lo:104: 00000100:00100000:2.0:1787604063.863490:0:14783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604063.863624:0:14783:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed283995cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787604063.863738:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355246080 00000100:00100000:1.0:1787604063.863747:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355246080 00000100:00100000:1.0:1787604063.863982:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787604063.863995:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e30912c-ffd9-4190-a569-23df3a025820+3:14783:x1874438355246080:12345-0@lo:104: 00010000:00010000:1.0:1787604063.864007:0:14336:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19024f4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.864064:0:14336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787604063.864070:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e30912c-ffd9-4190-a569-23df3a025820+3:14783:x1874438355246080:12345-0@lo:104: Request processed in 79us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604063.864076:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787604063.864344:0:14783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14783:1874438355246080:0@lo:104: 00010000:00010000:2.0:1787604063.864363:0:14783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.864746:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604063.864752:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19024f4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.864760:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962000 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:1.0:1787604063.864763:0:14341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19024f4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.864772:0:14341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19024f4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604063.864779:0:14341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19024f4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604063.864798:0:14341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787604063.865014:0:14341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19024f4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.865021:0:14341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787604063.865055:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19024f4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.865062:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962000/0xb5d1f3b1a19024ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19024f4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.865076:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604063.865078:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604063.865079:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604063.865336:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787604063.865351:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e30912c-ffd9-4190-a569-23df3a025820:3282:1874438355246208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604063.865402:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604063.868169:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355246208 00000100:00100000:1.0:1787604063.868184:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355246208 00010000:00010000:1.0:1787604063.868226:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b5dac000/0xb5d1f3b1a19024f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19024ed expref: 12 pid: 14345 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604063.868263:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787604063.868273:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e30912c-ffd9-4190-a569-23df3a025820+12:3282:x1874438355246208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787604063.868287:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604063.868293:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b5dac000/0xb5d1f3b1a19024f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19024ed expref: 12 pid: 14345 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.868305:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b5dac000/0xb5d1f3b1a19024f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19024ed expref: 12 pid: 14345 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.868334:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5dac000/0xb5d1f3b1a19024f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19024ed expref: 12 pid: 14345 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.868350:0:14337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.868357:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.868374:0:14337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.868381:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.868388:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.868395:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.868401:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963000 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787604063.868405:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.868412:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.868433:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604063.868454:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604063.868526:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e30912c-ffd9-4190-a569-23df3a025820+11:3282:x1874438355246208:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (3123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604063.868533:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787604063.868576:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e30912c-ffd9-4190-a569-23df3a025820:3282:1874438355246208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787604063.869067:0:14783:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604063.869081:0:14783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604063.869098:0:14783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b4963000/0xb5d1f3b1a1902533 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604064.727292:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787604065.175342:0:14349:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787604065.175351:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed283965800 from 10 10000000:01000000:3.0:1787604065.175356:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787604065.175419:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604065.175431:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604065.175442:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604065.175483:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355246336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787604065.175554:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604065.175626:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355246336 00000100:00100000:3.0:1787604065.175629:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c6600 going to sleep for 11 seconds 00000100:00100000:0.0:1787604065.175634:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355246336 00000100:00100000:0.0:1787604065.175698:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787604065.175707:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+11:14349:x1874438355246336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787604065.175720:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604065.175734:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a1902541 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190253a expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604065.175754:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a1902541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190253a expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604065.175764:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a1902541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190253a expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604065.175773:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594600, rc 0) 00000100:00100000:0.0:1787604065.175816:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+12:14349:x1874438355246336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604065.175822:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787604065.176107:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355246336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787604065.176121:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902541 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604065.176129:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1902541 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604065.176181:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355246464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787604065.176207:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604065.176228:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787604065.176448:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355246464 00000100:00100000:2.0:1787604065.176452:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355246464 00000100:00100000:2.0:1787604065.176487:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787604065.176493:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+12:14349:x1874438355246464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787604065.176777:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+12:14349:x1874438355246464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604065.176784:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787604065.178791:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355246464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787604065.178890:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355246592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787604065.178973:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604065.179014:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf6c6600 going to sleep for 11 seconds 00000100:00100000:1.0:1787604065.179136:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355246592 00000100:00100000:1.0:1787604065.179143:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355246592 00000100:00100000:1.0:1787604065.179191:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787604065.179201:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+12:14349:x1874438355246592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604065.179391:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+12:14349:x1874438355246592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604065.179399:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787604065.180308:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355246592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787604065.184363:0:14844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787604065.184471:0:14349:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787604065.184496:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787604065.184584:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902541 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604065.184596:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902541 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604065.757248:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604066.272030:0:3280:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604056/real 1787604056] req@ffff9ed2c1ec7800 x1874438355243264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604066 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604066.272060:0:3280:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ed2c1ec7800 x1874438355243264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604066 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604066.272083:0:3280:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604056/real 1787604056] req@ffff9ed2c1ec6a00 x1874438355243136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604066 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604066.272096:0:3280:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ed2c1ec6a00 x1874438355243136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604066 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787604066.272301:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed1835bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787604066.272420:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787604066.272425:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355243264:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787604066.272431:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed287c4e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787604066.272522:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e30912c-ffd9-4190-a569-23df3a025820:3282:1874438355246720:0@lo:400:kworker.0 00000100:00100000:1.0:1787604066.272590:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604066.272680:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355246720 00000100:00100000:2.0:1787604066.272691:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355246720 00000100:00100000:2.0:1787604066.272743:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787604066.272764:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+12:3282:x1874438355246720:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787604066.272822:0:13916:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604066.272826:0:13916:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787604066.272829:0:13916:0:(import.c:65:import_set_state_nolock()) ffff9ed287c4e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787604066.272833:0:13916:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:0.0:1787604066.272851:0:13916:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787604066.272856:0:13916:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ed287c4e000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:0.0:1787604066.272882:0:13916:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2b9df7b80 x1874438355246848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787604066.272893:0:13916:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604066.272896:0:13916:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787604066.272898:0:13916:0:(import.c:65:import_set_state_nolock()) ffff9ed1835bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787604066.272901:0:13916:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:0.0:1787604066.272903:0:13916:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787604066.272916:0:13916:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ed1835bb000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:0.0:1787604066.272926:0:13916:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2b9df5c00 x1874438355246976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787604066.273329:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787604066.273334:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355243136:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787604066.273356:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355246848:0@lo:8:kworker.0 00000400:00000100:3.0:1787604066.273386:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438355246848 offset 0 length 520: 4 00000100:00100000:3.0:1787604066.273410:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355246976:0@lo:8:kworker.0 00000400:00000100:3.0:1787604066.273429:0:3280:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438355246976 offset 0 length 520: 4 00000100:00100000:2.0:1787604066.279123:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+12:3282:x1874438355246720:12345-0@lo:400:kworker.0 Request processed in 6341us (6513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604066.279140:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787604066.279184:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355247104:0@lo:400:kworker.0 00000100:00100000:2.0:1787604066.279267:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604066.279902:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355247104 00000100:00100000:3.0:1787604066.279922:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355247104 00000100:00100000:3.0:1787604066.279972:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787604066.279981:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355247104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604066.280050:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355247104:12345-0@lo:400:kworker.0 Request processed in 70us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604066.280056:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787604066.280137:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ed2b9df6300 x1874438355247104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604066.280159:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355247104:0@lo:400:kworker.0 00000100:00100000:1.0:1787604066.282799:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e30912c-ffd9-4190-a569-23df3a025820:3282:1874438355246720:0@lo:400:kworker.0 00010000:00010000:2.0:1787604066.776884:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604067.802923:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787604068.058009:0:14384:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787604068.058019:0:14384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787604068.060261:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787604068.061416:0:14384:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787604068.061456:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000020:01000004:2.0:1787604068.659869:0:15032:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787604068.659873:0:15032:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787604068.659992:0:15032:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ed287187000 00000020:01000004:2.0:1787604068.660006:0:15032:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787604068.660017:0:15032:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787604068.660031:0:15032:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ed2b9ee8000) 00000020:00000080:2.0:1787604068.660045:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787604068.677607:0:15032:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787604068.678033:0:15032:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787604068.679131:0:15032:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787604068.679553:0:15032:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787604068.680067:0:15032:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787604068.680425:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1787604068.680595:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1787604068.680689:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1787604068.681251:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 380: rc = 0 00100000:10000000:2.0:1787604068.681660:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 380: rc = 0 00100000:10000000:2.0:1787604068.682052:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 380: rc = 0 00100000:10000000:2.0:1787604068.682300:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 380: rc = 0 00100000:10000000:2.0:1787604068.683657:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 380: rc = 0 00100000:10000000:2.0:1787604068.684252:0:15032:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 380: rc = 0 00000020:00000080:2.0:1787604068.685147:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787604068.685159:0:15032:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787604068.685170:0:15032:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb5d1f3b1a190254f 00000020:01000004:2.0:1787604068.685185:0:15032:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787604068.685206:0:15032:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787604068.685210:0:15032:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787604068.685214:0:15032:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787604068.685219:0:15032:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787604068.685230:0:15032:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ed2b50b8000) 00000020:00000080:2.0:1787604068.685242:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787604068.687044:0:15032:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787604068.688547:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787604068.688557:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787604068.695016:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787604068.695049:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787604068.697203:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787604068.697218:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787604068.701185:0:15032:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787604068.701403:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787604068.701409:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787604068.711083:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787604068.711110:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787604068.734472:0:15032:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787604068.734734:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787604068.734742:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787604068.735921:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787604068.735932:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787604068.736971:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787604068.736980:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787604068.738687:0:15032:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787604068.738924:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787604068.738930:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787604068.742141:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787604068.742157:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787604068.799738:0:15032:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787604068.799968:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787604068.799973:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787604068.800756:0:15032:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787604068.800764:0:15032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787604068.801296:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787604068.801369:0:15032:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787604068.801375:0:15032:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787604068.811414:0:15032:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.121@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787604068.811453:0:15032:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.121@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787604068.811459:0:15032:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787604068.811461:0:15032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787604068.811462:0:15032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604068.811463:0:15032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604068.811464:0:15032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604068.811465:0:15032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604068.811467:0:15032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787604068.811468:0:15032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604068.811470:0:15032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787604068.811473:0:15032:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787604068.811475:0:15032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787604068.811476:0:15032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787604068.811478:0:15032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604068.811479:0:15032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604068.811485:0:15032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604068.811487:0:15032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604068.811488:0:15032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787604068.811488:0:15032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604068.811489:0:15032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787604068.811517:0:15032:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787604068.811537:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355247232:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787604068.811604:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.812004:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787604068.814434:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355247232 00000100:00100000:3.0:1787604068.814449:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355247232 00000100:00100000:3.0:1787604068.814522:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787604068.814534:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+12:15032:x1874438355247232:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787604068.814566:0:14347:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787604068.814572:0:14347:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787604068.814576:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1787604068.824020:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604068.847298:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+12:15032:x1874438355247232:12345-0@lo:253:mount.lustre.0 Request processed in 32756us (35684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604068.847313:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787604068.847433:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355247232:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787604068.847450:0:15032:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787604068.847454:0:15032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787604068.847456:0:15032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787604068.847457:0:15032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604068.847458:0:15032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604068.847459:0:15032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604068.847460:0:15032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604068.847462:0:15032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787604068.847463:0:15032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604068.847465:0:15032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787604068.847487:0:15032:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ed287187000 from lustre-OST0000 10000000:01000000:0.0:1787604068.847536:0:15032:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787604068.847539:0:15032:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787604068.847546:0:15032:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ed2b6130000 local copy 00010000:00010000:0.0:1787604068.847556:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190244c expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604068.847802:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355247360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604068.847867:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.847915:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed284e31cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604068.848040:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355247360 00000100:00100000:2.0:1787604068.848047:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355247360 00000100:00100000:2.0:1787604068.848081:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787604068.848090:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+12:15032:x1874438355247360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604068.848237:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+12:15032:x1874438355247360:12345-0@lo:501:mount.lustre.0 Request processed in 147us (370us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787604068.848245:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787604068.848372:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355247360:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787604068.848383:0:15032:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787604068.848520:0:15032:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787604068.848527:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190244c expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.848536:0:15032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190244c expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604068.848558:0:15032:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ed287187000 10000000:01000000:0.0:1787604068.848562:0:15032:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787604068.848566:0:15032:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ed2b6130000 10000000:01000000:0.0:1787604068.848569:0:15032:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787604068.848572:0:15032:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ed2b6130000 from 1 10000000:01000000:0.0:1787604068.848576:0:15032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787604068.848599:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595600/0xb5d1f3b1a190255d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.848606:0:15032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed298595600/0xb5d1f3b1a190255d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.848627:0:15032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed298595600/0xb5d1f3b1a190255d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604068.848640:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355247488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787604068.848667:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.848688:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed284e31cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787604068.848786:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355247488 00000100:00100000:1.0:1787604068.848791:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355247488 00000100:00100000:1.0:1787604068.848822:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787604068.848830:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+12:15032:x1874438355247488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787604068.848866:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604068.848880:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2bec7e600/0xb5d1f3b1a1902564 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190255d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604068.848912:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2bec7e600/0xb5d1f3b1a1902564 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190255d expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604068.848921:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2bec7e600/0xb5d1f3b1a1902564 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190255d expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604068.848930:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e600, rc 0) 00000100:00100000:1.0:1787604068.848959:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+13:15032:x1874438355247488:12345-0@lo:101:mount.lustre.0 Request processed in 130us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604068.848972:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787604068.849084:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355247488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604068.849096:0:15032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed298595600/0xb5d1f3b1a190255d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902564 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.849104:0:15032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed298595600/0xb5d1f3b1a190255d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1902564 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604068.849127:0:15032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787604068.849144:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595600/0xb5d1f3b1a190255d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902564 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.849151:0:15032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed298595600/0xb5d1f3b1a190255d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902564 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604068.849158:0:15032:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787604068.849161:0:15032:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787604068.849165:0:15032:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787604068.849167:0:15032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787604068.849180:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298594a00/0xb5d1f3b1a190256b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.849188:0:15032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed298594a00/0xb5d1f3b1a190256b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.849195:0:15032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed298594a00/0xb5d1f3b1a190256b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604068.849207:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355247616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787604068.849232:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.849264:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed284e31cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604068.849318:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355247616 00000100:00100000:2.0:1787604068.849322:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355247616 00000100:00100000:2.0:1787604068.849355:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787604068.849362:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+13:15032:x1874438355247616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604068.849369:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604068.849382:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b4962600/0xb5d1f3b1a1902572 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190256b expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.849395:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4962600/0xb5d1f3b1a1902572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190256b expref: 14 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.849403:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b4962600/0xb5d1f3b1a1902572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190256b expref: 14 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.849409:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962600, rc 0) 00000100:00100000:2.0:1787604068.849435:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+14:15032:x1874438355247616:12345-0@lo:101:mount.lustre.0 Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604068.849441:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787604068.849549:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355247616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604068.849560:0:15032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed298594a00/0xb5d1f3b1a190256b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902572 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.849566:0:15032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed298594a00/0xb5d1f3b1a190256b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1902572 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787604068.850188:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787604068.851168:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787604068.851403:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787604068.851446:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787604068.851480:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787604068.851526:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787604068.851563:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787604068.851595:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787604068.851902:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787604068.851910:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787604068.851988:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355247744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604068.852050:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.852092:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed284e31540 going to sleep for 11 seconds 00000100:00100000:2.0:1787604068.852220:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355247744 00000100:00100000:2.0:1787604068.852228:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355247744 00000100:00100000:2.0:1787604068.852278:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787604068.852287:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+14:15032:x1874438355247744:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604068.852596:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+14:15032:x1874438355247744:12345-0@lo:501:mount.lustre.0 Request processed in 310us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604068.852604:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787604068.852800:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355247744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604068.852833:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355247872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604068.852912:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.852935:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed284e31540 going to sleep for 11 seconds 00000100:00100000:2.0:1787604068.852983:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355247872 00000100:00100000:2.0:1787604068.852987:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355247872 00000100:00100000:2.0:1787604068.853053:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787604068.853061:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+14:15032:x1874438355247872:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787604068.853346:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+14:15032:x1874438355247872:12345-0@lo:503:mount.lustre.0 Request processed in 286us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604068.853353:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787604068.853950:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355247872:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787604068.854819:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787604068.854958:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604068.855020:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.855481:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed284e31540 going to sleep for 11 seconds 00000100:00100000:3.0:1787604068.855559:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355248000 00000100:00100000:3.0:1787604068.855565:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355248000 00000100:00100000:3.0:1787604068.855603:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787604068.855625:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+14:15032:x1874438355248000:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787604068.855961:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+14:15032:x1874438355248000:12345-0@lo:502:mount.lustre.0 Request processed in 349us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604068.855968:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787604068.856153:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604068.856405:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787604068.856455:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787604068.856501:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787604068.856561:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787604068.856601:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787604068.856650:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787604068.856698:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787604068.856733:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787604068.856767:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787604068.856813:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787604068.856875:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787604068.856951:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787604068.856986:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604068.857045:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.857073:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed284e31540 going to sleep for 11 seconds 00000100:00100000:3.0:1787604068.857201:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355248128 00000100:00100000:3.0:1787604068.857207:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355248128 00000100:00100000:3.0:1787604068.857236:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787604068.857244:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+14:15032:x1874438355248128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787604068.857416:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+14:15032:x1874438355248128:12345-0@lo:502:mount.lustre.0 Request processed in 172us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604068.857429:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787604068.857678:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604068.857743:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787604068.857752:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787604068.858705:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787604068.858715:0:15047:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787604068.858721:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604068.858724:0:15047:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787604068.858729:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787604068.858743:0:15047:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ed2ba1eb370) 00000020:00000080:3.0:1787604068.858763:0:15047:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787604068.858770:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787604068.859021:0:15047:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ed287187000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787604068.859029:0:15047:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787604068.859036:0:15047:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb5d1f3b1a1902580 00010000:00010000:0.0:1787604068.865245:0:15047:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787604068.865729:0:15047:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1787604068.867811:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787604068.869220:0:15047:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787604068.869231:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787604068.869237:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604068.869239:0:15047:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787604068.869242:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787604068.869245:0:15047:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787604068.869247:0:15047:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787604068.869248:0:15047:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787604068.869250:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787604068.869259:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604068.869261:0:15047:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787604068.869264:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787604068.869267:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604068.869268:0:15047:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787604068.869271:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787604068.869273:0:15047:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787604068.869275:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787604068.869277:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604068.869278:0:15047:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787604068.869280:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787604068.869283:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604068.869284:0:15047:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787604068.869287:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787604068.869339:0:15047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787604068.869343:0:15047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604068.869344:0:15047:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787604068.869347:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787604068.870060:0:15032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787604068.870093:0:15032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787604068.870116:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298594a00/0xb5d1f3b1a190256b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902572 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604068.870129:0:15032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed298594a00/0xb5d1f3b1a190256b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902572 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604068.870186:0:15032:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed287187000 from 1 10000000:01000000:0.0:1787604068.870190:0:15032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787604068.870226:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.870235:0:15032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.870246:0:15032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604068.870271:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787604068.870336:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.870381:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787604068.870430:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355248256 00000100:00100000:2.0:1787604068.870446:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355248256 00000100:00100000:2.0:1787604068.870492:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787604068.870503:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+14:15032:x1874438355248256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604068.870516:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604068.870528:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a190258e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1902587 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.870551:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a190258e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902587 expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.870561:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a190258e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902587 expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.870568:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962c00, rc 0) 00000100:00100000:2.0:1787604068.870623:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+15:15032:x1874438355248256:12345-0@lo:101:mount.lustre.0 Request processed in 112us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604068.870629:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787604068.870794:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248256:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787604068.870809:0:15032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190258e expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604068.870818:0:15032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190258e expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787604068.871332:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787604068.877070:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787604068.877466:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787604068.877515:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787604068.877581:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787604068.877590:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787604068.878026:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604068.878091:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.878683:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787604068.882877:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355248384 00000100:00100000:1.0:1787604068.882902:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355248384 00000100:00100000:1.0:1787604068.882953:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787604068.882965:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+15:15032:x1874438355248384:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604068.883283:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+15:15032:x1874438355248384:12345-0@lo:501:mount.lustre.0 Request processed in 319us (5190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604068.883291:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787604068.883438:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604068.883488:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604068.883535:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.883564:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787604068.883759:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355248512 00000100:00100000:2.0:1787604068.883764:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355248512 00000100:00100000:2.0:1787604068.883800:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787604068.883809:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+15:15032:x1874438355248512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787604068.883974:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+15:15032:x1874438355248512:12345-0@lo:503:mount.lustre.0 Request processed in 166us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604068.883981:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787604068.884061:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248512:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787604068.884499:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787604068.884562:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604068.884601:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.884767:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787604068.885737:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355248640 00000100:00100000:1.0:1787604068.885744:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355248640 00000100:00100000:1.0:1787604068.885786:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787604068.885804:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+15:15032:x1874438355248640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604068.886015:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+15:15032:x1874438355248640:12345-0@lo:502:mount.lustre.0 Request processed in 212us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604068.886024:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787604068.886223:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604068.886484:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787604068.886532:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787604068.886573:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787604068.886605:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787604068.886747:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787604068.886795:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787604068.886828:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787604068.887124:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787604068.887162:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604068.887215:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.887301:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787604068.887337:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355248768 00000100:00100000:1.0:1787604068.887344:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355248768 00000100:00100000:1.0:1787604068.887413:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787604068.887423:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+15:15032:x1874438355248768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604068.887588:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+15:15032:x1874438355248768:12345-0@lo:502:mount.lustre.0 Request processed in 165us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604068.887596:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787604068.887714:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604068.891212:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787604068.891239:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787604068.892429:0:15051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787604068.892440:0:15051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604068.892443:0:15051:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787604068.892449:0:15051:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ed287187000 00000020:00000080:3.0:1787604068.892452:0:15051:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787604068.892459:0:15051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787604068.892461:0:15051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604068.892463:0:15051:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787604068.892465:0:15051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787604068.892467:0:15051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604068.892468:0:15051:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787604068.892471:0:15051:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ed287187000 00000020:00000080:3.0:1787604068.892473:0:15051:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787604068.892560:0:15051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787604068.892564:0:15051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604068.892566:0:15051:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787604068.892568:0:15051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787604068.892571:0:15051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604068.892572:0:15051:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787604068.892575:0:15051:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ed287187000 00000020:00000080:3.0:1787604068.892577:0:15051:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787604068.904269:0:15051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787604068.904281:0:15051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604068.904294:0:15051:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787604068.904299:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787604068.904587:0:15032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787604068.904616:0:15032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787604068.904633:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190258e expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.904645:0:15032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190258e expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604068.904688:0:15032:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787604068.904691:0:15032:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ed287187000 10000000:01000000:0.0:1787604068.904693:0:15032:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ed287187000 10000000:01000000:0.0:1787604068.904697:0:15032:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787604068.904702:0:15032:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ed287187000 from 1 10000000:01000000:0.0:1787604068.904705:0:15032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787604068.904739:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a1902595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.904747:0:15032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a1902595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.904758:0:15032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a1902595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604068.904779:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787604068.904863:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.904906:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4540 going to sleep for 11 seconds 00000100:00100000:3.0:1787604068.905075:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355248896 00000100:00100000:3.0:1787604068.905081:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355248896 00000100:00100000:3.0:1787604068.905234:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787604068.905245:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+15:15032:x1874438355248896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604068.905256:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604068.905268:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dadc00/0xb5d1f3b1a190259c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1902595 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604068.905290:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dadc00/0xb5d1f3b1a190259c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902595 expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604068.905299:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b5dadc00/0xb5d1f3b1a190259c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902595 expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604068.905308:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dadc00, rc 0) 00000100:00100000:3.0:1787604068.905342:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+16:15032:x1874438355248896:12345-0@lo:101:mount.lustre.0 Request processed in 99us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604068.905349:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787604068.905720:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355248896:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604068.905734:0:15032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a1902595 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190259c expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.905742:0:15032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a1902595 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a190259c expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787604068.909338:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787604068.909738:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787604068.910026:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787604068.910072:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787604068.910108:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787604068.911496:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787604068.911532:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787604068.912343:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787604068.912390:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787604068.912434:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787604068.912483:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787604068.912519:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787604068.912552:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787604068.912602:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787604068.912639:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787604068.912675:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787604068.912742:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787604068.912779:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787604068.912812:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787604068.912881:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787604068.912932:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787604068.912965:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787604068.913016:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787604068.913055:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787604068.913090:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787604068.914233:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787604068.914279:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787604068.914313:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787604068.914376:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787604068.914414:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787604068.914500:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787604068.914508:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787604068.914608:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355249024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604068.914670:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.914706:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787604068.914744:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355249024 00000100:00100000:1.0:1787604068.914751:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355249024 00000100:00100000:1.0:1787604068.914791:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787604068.914800:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+16:15032:x1874438355249024:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604068.915236:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+16:15032:x1874438355249024:12345-0@lo:501:mount.lustre.0 Request processed in 436us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604068.915244:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787604068.915761:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355249024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604068.915797:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355249152:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604068.915857:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.915893:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787604068.920064:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355249152 00000100:00100000:1.0:1787604068.920078:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355249152 00000100:00100000:1.0:1787604068.920129:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787604068.920139:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+16:15032:x1874438355249152:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787604068.920371:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+16:15032:x1874438355249152:12345-0@lo:503:mount.lustre.0 Request processed in 232us (4512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604068.920379:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787604068.921518:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355249152:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787604068.922082:0:15032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787604068.922181:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355249280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604068.922239:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.922272:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed283995e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787604068.922380:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355249280 00000100:00100000:1.0:1787604068.922392:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355249280 00000100:00100000:1.0:1787604068.922440:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787604068.922449:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+16:15032:x1874438355249280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604068.922628:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+16:15032:x1874438355249280:12345-0@lo:502:mount.lustre.0 Request processed in 180us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604068.922636:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787604068.923633:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355249280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604068.923953:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787604068.924004:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787604068.924038:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787604068.924085:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787604068.924122:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787604068.924172:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787604068.924208:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787604068.924251:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787604068.924301:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787604068.924335:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787604068.924364:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787604068.924409:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787604068.924445:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787604068.924477:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787604068.924547:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787604068.924585:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787604068.924617:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787604068.924665:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787604068.924702:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787604068.924738:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787604068.924800:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787604068.924870:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787604068.924921:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787604068.924972:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787604068.925007:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787604068.925041:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787604068.925102:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787604068.925141:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787604068.925176:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787604068.925223:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787604068.925273:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787604068.925303:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787604068.925332:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787604068.925381:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787604068.925418:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787604068.925468:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787604068.925506:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787604068.925540:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787604068.925587:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787604068.925625:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787604068.925679:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355249408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604068.925753:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.925803:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2c1ca4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787604068.926064:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355249408 00000100:00100000:1.0:1787604068.926072:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355249408 00000100:00100000:1.0:1787604068.926120:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787604068.926130:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+16:15032:x1874438355249408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604068.926349:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+16:15032:x1874438355249408:12345-0@lo:502:mount.lustre.0 Request processed in 220us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604068.926356:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787604068.926925:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355249408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604068.927018:0:15032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787604068.927029:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787604068.928055:0:15056:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787604068.928074:0:15056:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ed28654cd28) 00000020:00000080:0.0:1787604068.928097:0:15056:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787604068.928193:0:15056:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ed287187000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787604068.928198:0:15056:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ed287187000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787604068.928200:0:15056:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ed287187000 3 00010000:00080000:0.0:1787604068.928229:0:15056:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ed2c1c8f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.121@tcp at head 00010000:00010000:0.0:1787604068.930273:0:15056:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787604068.930452:0:15056:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787604068.930486:0:15056:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787604068.930510:0:15056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb5d1f3b1a19025aa 00000100:00080000:0.0:1787604068.930519:0:15056:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787604068.930525:0:15056:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ed2c1c8f000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:0.0:1787604068.930560:0:15056:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2b9df4000 x1874438355249536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604068.930606:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874438355249536:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787604068.930670:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.931025:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355249536 00000100:00100000:0.0:1787604068.931032:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355249536 00000100:00100000:0.0:1787604068.931063:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787604068.931071:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3280:x1874438355249536:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787604068.931105:0:14352:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:0.0:1787604068.931135:0:14352:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb5d1f3b1a19025b1 00000004:00100000:0.0:1787604068.931151:0:14352:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787604068.931179:0:14352:0:(import.c:65:import_set_state_nolock()) ffff9ed182408800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787604068.931228:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874438355249536:12345-0@lo:38:llog_process_th.0 Request processed in 156us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604068.931236:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787604068.931283:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ed2b9df4000 x1874438355249536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787604078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604068.931293:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787604068.931301:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787604068.931309:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787604068.931313:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787604068.931315:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed2c1c8f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787604068.931322:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3280:1874438355249536:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787604068.931339:0:15056:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787604068.931360:0:13916:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604068.931364:0:13916:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787604068.931367:0:13916:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604068.931370:0:13916:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787604068.931413:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355249664:0@lo:400:kworker.0 00000100:00100000:0.0:1787604068.931441:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.931475:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355249664 00000100:00100000:0.0:1787604068.931484:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355249664 00000100:00100000:0.0:1787604068.931511:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787604068.931517:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355249664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604068.931549:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874438355249664:12345-0@lo:400:kworker.0 Request processed in 32us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604068.931555:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787604068.931579:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ed2b9df4000 x1874438355249664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604068.931589:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874438355249664:0@lo:400:kworker.0 00000040:00080000:0.0:1787604068.937455:0:15056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787604068.937596:0:15032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787604068.937622:0:15032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787604068.937642:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a1902595 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190259c expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604068.937653:0:15032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed298595400/0xb5d1f3b1a1902595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190259c expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787604068.937697:0:15032:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787604068.937699:0:15032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787604068.937701:0:15032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787604068.937702:0:15032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787604068.937704:0:15032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787604068.937705:0:15032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787604068.937707:0:15032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787604068.937708:0:15032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787604068.937709:0:15032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787604068.937717:0:15032:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787604068.937719:0:15032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787604068.937720:0:15032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787604068.937721:0:15032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787604068.937722:0:15032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787604068.937723:0:15032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787604068.937724:0:15032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787604068.937725:0:15032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787604068.937726:0:15032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787604068.937726:0:15032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787604068.937750:0:15032:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787604068.937768:0:15032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355249792:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787604068.937859:0:15032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604068.937907:0:15032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286a963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604068.938164:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355249792 00000100:00100000:0.0:1787604068.938172:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355249792 00000100:00100000:0.0:1787604068.938217:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787604068.938227:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+16:15032:x1874438355249792:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787604068.938253:0:14346:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787604068.938266:0:14346:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787604068.983228:0:14346:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787604068.983279:0:14346:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787604068.984814:0:14368:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787604068.984822:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787604068.984945:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604068.984964:0:14368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190251e expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604068.984972:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.985124:0:14368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190251e expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.985138:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190251e expref: 16 pid: 14345 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604068.985152:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14368:1874438355249920:0@lo:104: 00000100:00100000:0.0:1787604068.985213:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604068.985256:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28965ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604068.985312:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355249920 00000100:00100000:2.0:1787604068.985319:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355249920 00000100:00100000:2.0:1787604068.985365:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787604068.985373:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e30912c-ffd9-4190-a569-23df3a025820+3:14368:x1874438355249920:12345-0@lo:104: 00010000:00010000:2.0:1787604068.985392:0:14335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1902525 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.985447:0:14335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787604068.985453:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e30912c-ffd9-4190-a569-23df3a025820+3:14368:x1874438355249920:12345-0@lo:104: Request processed in 81us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604068.985460:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787604068.985479:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604068.985484:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1902525 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.985492:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962200 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:2.0:1787604068.985496:0:14341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1902525 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.985505:0:14341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1902525 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604068.985512:0:14341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1902525 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604068.985518:0:14341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787604068.985540:0:14341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1902525 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.985546:0:14341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604068.985895:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1902525 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.985903:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a190251e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1902525 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.985924:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604068.985926:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604068.985928:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604068.986004:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14368:1874438355249920:0@lo:104: 00010000:00010000:0.0:1787604068.986028:0:14368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604068.986092:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e30912c-ffd9-4190-a569-23df3a025820:3281:1874438355250048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604068.986128:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604068.986229:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355250048 00000100:00100000:2.0:1787604068.986234:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355250048 00010000:00010000:2.0:1787604068.986254:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190251e expref: 17 pid: 14345 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604068.986286:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787604068.986293:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e30912c-ffd9-4190-a569-23df3a025820+17:3281:x1874438355250048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604068.986304:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604068.986310:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190251e expref: 17 pid: 14345 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.986320:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190251e expref: 17 pid: 14345 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.986333:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190251e expref: 17 pid: 14345 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.986346:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.986354:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787604068.986367:0:14339:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001545728s 00010000:00010000:2.0:1787604068.986372:0:14339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.986389:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.986396:0:14339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.986403:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.986409:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dada00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604068.986413:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.986422:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.986443:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604068.986453:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604068.986488:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e30912c-ffd9-4190-a569-23df3a025820+16:3281:x1874438355250048:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604068.986496:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787604068.986522:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e30912c-ffd9-4190-a569-23df3a025820:3281:1874438355250048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787604068.986711:0:14368:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.986720:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604068.986726:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b5dada00/0xb5d1f3b1a19025b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604068.992075:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+15:15032:x1874438355249792:12345-0@lo:253:mount.lustre.0 Request processed in 53839us (54207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604068.992089:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787604068.992198:0:15032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15032:1874438355249792:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787604068.992214:0:15032:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787604068.992217:0:15032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787604068.992219:0:15032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787604068.992220:0:15032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787604068.992221:0:15032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787604068.992223:0:15032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787604068.992224:0:15032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787604068.992225:0:15032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787604068.992228:0:15032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787604068.992229:0:15032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787604068.992244:0:15032:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787604068.997770:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604068.998025:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787604068.998435:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604069.010856:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787604069.011104:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604069.011269:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787604069.013477:0:15032:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787604069.099460:0:15032:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787604069.099469:0:15032:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787604069.099507:0:15032:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787604069.099571:0:15032:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787604069.099588:0:15032:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787604069.099694:0:15032:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787604069.851974:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787604070.422985:0:14349:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787604070.422996:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ed283965800 from 7 10000000:01000000:0.0:1787604070.423025:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787604070.423094:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604070.423109:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604070.423125:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604070.423161:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355250176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787604070.423262:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604070.424264:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355250176 00000100:00100000:2.0:1787604070.424278:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355250176 00000100:00100000:2.0:1787604070.424373:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787604070.424386:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+15:14349:x1874438355250176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787604070.424420:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604070.424441:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19025c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19025bf expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604070.424473:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19025c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19025bf expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604070.424486:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19025c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19025bf expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604070.424499:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963c00, rc 0) 00000100:00100000:2.0:1787604070.424563:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+16:14349:x1874438355250176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604070.424571:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787604070.425024:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bf4f6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787604070.425056:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355250176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787604070.425076:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19025c6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604070.425087:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19025c6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604070.425179:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355250304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787604070.425229:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604070.425265:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286a96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787604070.425865:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355250304 00000100:00100000:3.0:1787604070.425883:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355250304 00000100:00100000:3.0:1787604070.425961:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787604070.425972:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+16:14349:x1874438355250304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787604070.425994:0:14347:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787604070.426018:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787604070.426022:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787604070.426132:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+16:14349:x1874438355250304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604070.426141:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787604070.426624:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355250304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787604070.426724:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787604070.426735:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19025c6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604070.426745:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19025c6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604070.873978:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604071.902787:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604072.919046:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604073.942939:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604073.943263:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e30912c-ffd9-4190-a569-23df3a025820:3282:1874438355250432:0@lo:400:kworker.0 00000100:00100000:0.0:1787604073.943332:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787604073.943395:0:13916:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604073.943399:0:13916:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787604073.943402:0:13916:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604073.943405:0:13916:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787604073.943444:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355250560:0@lo:400:kworker.0 00000100:00100000:2.0:1787604073.943474:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604073.943498:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787604073.943503:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355250688:0@lo:400:kworker.0 00000100:00100000:2.0:1787604073.943525:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604073.943562:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355250560 00000100:00100000:2.0:1787604073.943570:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355250560 00000100:00100000:2.0:1787604073.943609:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355250688 00000100:00100000:2.0:1787604073.943626:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355250688 00000100:00100000:2.0:1787604073.943662:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787604073.943670:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355250560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604073.943719:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355250560:12345-0@lo:400:kworker.0 Request processed in 50us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604073.943726:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787604073.943742:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787604073.943749:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355250688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604073.943773:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355250688:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604073.943779:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787604073.943818:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2c1ec7b80 x1874438355250688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604073.943832:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355250688:0@lo:400:kworker.0 00010000:00080000:2.0:1787604073.943877:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2c1ec5500 x1874438355250560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604073.943886:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355250560:0@lo:400:kworker.0 00000100:00080000:3.0:1787604073.944019:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787604073.944162:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355250432 00000100:00100000:0.0:1787604073.944167:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355250432 00000100:00100000:0.0:1787604073.944204:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787604073.944211:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+16:3282:x1874438355250432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604073.944250:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+16:3282:x1874438355250432:12345-0@lo:400:kworker.0 Request processed in 40us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604073.944257:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787604073.944289:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e30912c-ffd9-4190-a569-23df3a025820:3282:1874438355250432:0@lo:400:kworker.0 00000001:02000400:3.0:1787604074.753573:0:15400:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787604074.970434:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604075.991328:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604077.015006:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604078.040385:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787604078.299433:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1787604079.063068:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604079.063076:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787604079.063079:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604079.063081:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787604079.063134:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355251072:0@lo:400:kworker.0 00000100:00100000:2.0:1787604079.063204:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604079.063273:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355251072 00000100:00100000:2.0:1787604079.063279:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355251072 00000100:00100000:2.0:1787604079.063334:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787604079.063345:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355251072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604079.063398:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355251072:12345-0@lo:400:kworker.0 Request processed in 55us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604079.063405:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787604079.063429:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787604079.063475:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2c1ec4700 x1874438355251072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604079.063488:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355251072:0@lo:400:kworker.0 00000100:00100000:0.0:1787604079.063549:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e30912c-ffd9-4190-a569-23df3a025820:3281:1874438355250816:0@lo:400:kworker.0 00000100:00100000:0.0:1787604079.063582:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604079.063619:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787604079.063625:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355250944:0@lo:400:kworker.0 00000100:00100000:0.0:1787604079.063647:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604079.063676:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355250944 00000100:00100000:0.0:1787604079.063680:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355250944 00000100:00100000:0.0:1787604079.063705:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787604079.063712:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355250944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604079.063746:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355250944:12345-0@lo:400:kworker.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604079.063752:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787604079.063778:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2c1ec7b80 x1874438355250944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604079.063788:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355250944:0@lo:400:kworker.0 00010000:00010000:1.0:1787604079.063933:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604079.064019:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355250816 00000100:00100000:2.0:1787604079.064024:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355250816 00000100:00100000:2.0:1787604079.064060:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787604079.064066:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+16:3281:x1874438355250816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604079.064110:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+16:3281:x1874438355250816:12345-0@lo:400:kworker.0 Request processed in 44us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604079.064117:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787604079.064221:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e30912c-ffd9-4190-a569-23df3a025820:3281:1874438355250816:0@lo:400:kworker.0 00010000:00010000:1.0:1787604080.090364:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604081.111354:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604081.175943:0:3280:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604066/real 1787604066] req@ffff9ed2b9df7b80 x1874438355246848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604081 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604081.175975:0:3280:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ed2b9df7b80 x1874438355246848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604081 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604081.175987:0:3280:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604066/real 1787604066] req@ffff9ed2b9df5c00 x1874438355246976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604081 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604081.175998:0:3280:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ed2b9df5c00 x1874438355246976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604081 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787604081.176032:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed287c4e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787604081.176068:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787604081.176073:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355246848:0@lo:8:kworker.0 00000100:00080000:1.0:1787604081.176079:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed1835bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787604081.176085:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787604081.176088:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355246976:0@lo:8:kworker.0 00000100:00080000:2.0:1787604081.176294:0:13916:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604081.176299:0:13916:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787604081.176302:0:13916:0:(import.c:65:import_set_state_nolock()) ffff9ed287c4e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787604081.176307:0:13916:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 399 00000100:00080000:2.0:1787604081.176312:0:13916:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787604081.176318:0:13916:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ed287c4e000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:2.0:1787604081.176339:0:13916:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2c1ec6d80 x1874438355251328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787604081.176362:0:13916:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604081.176365:0:13916:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787604081.176367:0:13916:0:(import.c:65:import_set_state_nolock()) ffff9ed1835bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787604081.176370:0:13916:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 399 00000100:00080000:2.0:1787604081.176373:0:13916:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787604081.176376:0:13916:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ed1835bb000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:2.0:1787604081.176390:0:13916:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2c1ec7480 x1874438355251456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787604081.176438:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355251584:0@lo:400:kworker.0 00000100:00100000:2.0:1787604081.176501:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604081.176559:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787604081.176566:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355251712:0@lo:400:kworker.0 00000100:00100000:2.0:1787604081.176591:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604081.176625:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355251584 00000100:00100000:2.0:1787604081.176632:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355251584 00000100:00100000:2.0:1787604081.176682:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355251712 00000100:00100000:2.0:1787604081.176686:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355251712 00000100:00100000:2.0:1787604081.176713:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787604081.176722:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355251584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604081.176769:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355251584:12345-0@lo:400:kworker.0 Request processed in 48us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604081.176788:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787604081.176804:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787604081.176812:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355251712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604081.176872:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355251712:12345-0@lo:400:kworker.0 Request processed in 61us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604081.176885:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787604081.176914:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787604081.176941:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2c1ec5880 x1874438355251712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604081.176951:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355251712:0@lo:400:kworker.0 00010000:00080000:2.0:1787604081.176960:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2c1ec7100 x1874438355251584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604081.176967:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355251584:0@lo:400:kworker.0 00000100:00100000:2.0:1787604081.176986:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355251328:0@lo:8:kworker.0 00000100:00100000:2.0:1787604081.177016:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604081.177039:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355251456:0@lo:8:kworker.0 00000100:00100000:0.0:1787604081.177165:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e30912c-ffd9-4190-a569-23df3a025820:3284:1874438355251200:0@lo:400:kworker.0 00000100:00100000:0.0:1787604081.177199:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604081.177243:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355251328 00000100:00100000:0.0:1787604081.177247:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355251328 00000100:00100000:0.0:1787604081.177268:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787604081.177273:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874438355251328:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787604081.177298:0:15033:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:0.0:1787604081.177328:0:15033:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb5d1f3b1a19025cd 00002000:00100000:0.0:1787604081.177342:0:15033:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ed182409000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787604081.177346:0:15033:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787604081.177349:0:15033:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787604081.177642:0:15033:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787604081.177663:0:15033:0:(import.c:65:import_set_state_nolock()) ffff9ed18240d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787604081.177707:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1874438355251328:12345-0@lo:8:kworker.0 Request processed in 432us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604081.177714:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787604081.178010:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355251200 00000100:00100000:3.0:1787604081.178015:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355251200 00000100:00100000:3.0:1787604081.178046:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787604081.178491:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+16:3284:x1874438355251200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604081.178693:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787604081.178739:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2c1ec6d80 x1874438355251328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787604101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604081.178750:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787604081.178759:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787604081.178767:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787604081.178772:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787604081.178785:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed287c4e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787604081.178801:0:3280:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787604081.178806:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355251328:0@lo:8:kworker.0 00000100:00100000:2.0:1787604081.178857:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355251456 00000100:00100000:2.0:1787604081.178862:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355251456 00000100:00100000:2.0:1787604081.178885:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787604081.178899:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3280:x1874438355251456:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787604081.178914:0:15036:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787604081.178951:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3280:x1874438355251456:12345-0@lo:8:kworker.0 Request processed in 51us (257us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787604081.178957:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:2.0:1787604081.178980:0:14374:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787604081.179271:0:14374:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414243433034ns, next at 0ns, rc = 0 00000100:00080000:2.0:1787604081.179308:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed1835bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787604081.179314:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787604081.179317:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355251456:0@lo:8:kworker.0 00000100:00100000:3.0:1787604081.182924:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+16:3284:x1874438355251200:12345-0@lo:400:kworker.0 Request processed in 4427us (5713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604081.182940:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:3.0:1787604081.183048:0:14375:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787604081.183070:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14375:1874438355251968:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787604081.183132:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604081.183155:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b5c7f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787604081.183267:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355251968 00000100:00100000:3.0:1787604081.183281:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355251968 00000100:00100000:3.0:1787604081.183331:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787604081.183340:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14375:x1874438355251968:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787604081.185757:0:15035:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787604081.185768:0:15035:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787604081.185773:0:15035:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00080000:2.0:1787604081.187293:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787604081.202461:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e30912c-ffd9-4190-a569-23df3a025820:3284:1874438355251200:0@lo:400:kworker.0 00000100:00100000:1.0:1787604081.202499:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787604081.202567:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355251840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787604081.202643:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604081.203043:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355251840 00000100:00100000:0.0:1787604081.203050:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355251840 00000100:00100000:0.0:1787604081.203091:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787604081.203100:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355251840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787604081.203133:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787604081.203193:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355251840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604081.203200:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787604081.204504:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2bf6d9880 x1874438355251840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787604097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604081.204528:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355251840:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1787604081.211493:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.211506:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e94d8ad/0xb5d1f3b1a19025d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.211524:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.211529:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.211535:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e94d8ad/0xb5d1f3b1a19025d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.211553:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e94d8ad/0xb5d1f3b1a19025d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.211565:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e94d8ad/0xb5d1f3b1a19025d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.211572:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e94d8ad/0xb5d1f3b1a19025d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.211614:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787604081.217056:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.217070:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a19025db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.217088:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.217093:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.217100:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a19025db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.217115:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a19025db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.217127:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a19025db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.217136:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a19025db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.217819:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604081.217830:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e94d8ad/0xb5d1f3b1a19025d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.217852:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595e00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604081.217856:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e94d8ad/0xb5d1f3b1a19025d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.217866:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e94d8ad/0xb5d1f3b1a19025d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.217888:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e94d8ad/0xb5d1f3b1a19025d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.217896:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e94d8ad/0xb5d1f3b1a19025d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.217930:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.217932:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.217934:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.218365:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.218377:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.218381:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a19025db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.218388:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.218398:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a19025db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.218406:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a19025db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.218417:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a19025db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.218424:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a19025db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.218437:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.218439:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.218440:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604081.222636:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.222649:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19025e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.222665:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.222669:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.222675:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19025e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.225023:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19025e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.225044:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19025e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.225063:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19025e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.225096:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.225110:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.225116:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19025e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.225124:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.225129:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19025e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.225139:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19025e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.226048:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19025e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.226056:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a19025e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.226079:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.226081:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.226083:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604081.229622:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.229645:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a19025e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.229660:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.229664:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.229671:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a19025e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.229684:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a19025e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.229694:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a19025e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.229701:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a19025e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.229725:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.229742:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.229748:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a19025e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.229756:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594800 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.229760:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a19025e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.229768:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a19025e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.229804:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a19025e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.229811:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a19025e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.229832:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.229834:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.229865:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604081.230289:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.230295:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a19025f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230305:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.230308:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.230312:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a19025f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230322:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a19025f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230330:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a19025f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230338:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a19025f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230363:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.230373:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.230377:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a19025f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230384:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594400 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.230388:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a19025f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230397:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a19025f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230409:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a19025f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230416:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a19025f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230430:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.230432:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.230433:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604081.230884:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.230890:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a19025f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230899:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.230908:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.230913:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a19025f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230923:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a19025f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230931:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a19025f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230937:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a19025f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230949:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.230958:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.230962:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a19025f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230968:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594e00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.230971:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a19025f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230978:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a19025f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.230988:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a19025f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.231006:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a19025f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.231019:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.231021:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.231023:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604081.231407:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.231413:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19025fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.231423:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.231427:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.231432:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19025fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.231441:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19025fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.231449:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19025fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.231456:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19025fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.231470:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.231479:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.231488:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19025fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.231495:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594000 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.231498:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19025fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.231506:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19025fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.231517:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19025fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.231523:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a19025fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.231536:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.231538:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.231539:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604081.240335:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.240350:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aed56793/0xb5d1f3b1a1902605 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.240368:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.240373:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.240380:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aed56793/0xb5d1f3b1a1902605 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.240407:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aed56793/0xb5d1f3b1a1902605 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.240419:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aed56793/0xb5d1f3b1a1902605 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.240426:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aed56793/0xb5d1f3b1a1902605 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.240456:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604081.240542:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604081.240551:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aed56793/0xb5d1f3b1a1902605 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.240562:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595a00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604081.240568:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aed56793/0xb5d1f3b1a1902605 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.240578:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aed56793/0xb5d1f3b1a1902605 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.240608:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aed56793/0xb5d1f3b1a1902605 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.240616:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aed56793/0xb5d1f3b1a1902605 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.240639:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.240642:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.240645:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604081.244278:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.244290:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a190260c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.244307:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.244312:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.244318:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a190260c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.244332:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a190260c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.244343:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a190260c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.244364:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a190260c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.244382:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.244396:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.244401:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a190260c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.244411:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594000 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.244415:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a190260c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.244425:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a190260c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.244444:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a190260c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.244451:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f2c5ce8/0xb5d1f3b1a190260c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.244468:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.244470:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.244472:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604081.244961:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.244974:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1902613 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.244983:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.244986:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.244989:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1902613 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.244998:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1902613 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245006:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1902613 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245012:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1902613 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245035:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604081.245121:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604081.245129:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1902613 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.245152:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594e00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604081.245157:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1902613 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.245167:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1902613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.245182:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1902613 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.245191:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7de7433/0xb5d1f3b1a1902613 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.245212:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.245215:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.245218:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604081.245451:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.245458:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a190261a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245466:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.245470:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.245474:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a190261a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245484:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a190261a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245498:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a190261a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245506:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a190261a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245521:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.245530:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.245534:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a190261a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245541:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594400 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.245544:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a190261a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245552:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a190261a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245563:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a190261a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245569:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8f61f93/0xb5d1f3b1a190261a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.245583:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.245590:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.245592:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604081.246015:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.246021:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902621 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246031:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.246034:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.246039:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246048:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246057:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246065:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246088:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604081.246166:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604081.246172:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.246180:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594800 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604081.246185:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.246194:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902621 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.246215:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902621 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.246224:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e28b034f/0xb5d1f3b1a1902621 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.246247:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.246249:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.246252:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604081.246500:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.246506:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1902628 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246515:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.246518:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.246522:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1902628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246539:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1902628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246547:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1902628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246554:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1902628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246569:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.246578:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.246582:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1902628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246589:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.246592:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1902628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246600:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1902628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246611:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1902628 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246618:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094a0ef4c/0xb5d1f3b1a1902628 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.246641:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.246643:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.246645:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604081.251607:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.251619:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a190262f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.251637:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.251643:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.251649:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a190262f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.251664:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a190262f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.251675:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a190262f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.251684:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a190262f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787604081.255157:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787604081.255199:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604081.255237:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604081.255246:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a190262f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.255259:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604081.255265:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a190262f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.255276:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a190262f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.255297:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a190262f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.255305:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7509638/0xb5d1f3b1a190262f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.255337:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.255340:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.255344:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604081.255981:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604081.255989:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902636 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.256001:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787604081.256005:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604081.256011:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.256024:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.256033:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.256041:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902636 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.256062:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.256301:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.256309:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902636 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.256318:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963e00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.256330:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902636 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.256340:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.256354:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902636 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.256361:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902636 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.256384:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.256387:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.256389:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604081.256437:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604081.256444:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a190263d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.256461:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787604081.256464:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604081.256468:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a190263d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.256477:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a190263d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.256485:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a190263d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.256492:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a190263d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.256516:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.256771:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.256787:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a190263d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.256795:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963400 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.256799:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a190263d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.256808:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a190263d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.256821:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a190263d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.256882:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a190263d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.256899:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.256901:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.256903:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604081.256959:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604081.256965:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a4bcf5b/0xb5d1f3b1a1902644 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.256973:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787604081.256976:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604081.256980:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a4bcf5b/0xb5d1f3b1a1902644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.256989:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a4bcf5b/0xb5d1f3b1a1902644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.257008:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a4bcf5b/0xb5d1f3b1a1902644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.257015:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a4bcf5b/0xb5d1f3b1a1902644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.257036:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.257056:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.257062:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a4bcf5b/0xb5d1f3b1a1902644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.257070:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963800 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.257074:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a4bcf5b/0xb5d1f3b1a1902644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.257083:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a4bcf5b/0xb5d1f3b1a1902644 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.257096:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a4bcf5b/0xb5d1f3b1a1902644 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.257104:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a4bcf5b/0xb5d1f3b1a1902644 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.257119:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.257122:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.257125:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604081.257397:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604081.257402:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e155e14/0xb5d1f3b1a190264b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.257410:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787604081.257413:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604081.257417:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e155e14/0xb5d1f3b1a190264b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.257426:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e155e14/0xb5d1f3b1a190264b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.257434:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e155e14/0xb5d1f3b1a190264b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.257440:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e155e14/0xb5d1f3b1a190264b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.257471:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.257783:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.257789:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e155e14/0xb5d1f3b1a190264b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.257799:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.257803:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e155e14/0xb5d1f3b1a190264b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.257811:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e155e14/0xb5d1f3b1a190264b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.257823:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e155e14/0xb5d1f3b1a190264b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.257829:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e155e14/0xb5d1f3b1a190264b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.257872:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.257873:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.257875:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604081.260251:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604081.260262:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a1902652 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.260277:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787604081.260281:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604081.260286:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a1902652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.260299:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a1902652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.260308:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a1902652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.260317:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a1902652 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.260344:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.260795:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.260805:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a1902652 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.260815:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.260820:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a1902652 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.260875:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a1902652 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.260893:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a1902652 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.260900:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047191f73/0xb5d1f3b1a1902652 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787604081.261006:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604081.261012:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078e7ed69/0xb5d1f3b1a1902659 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.261021:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.261025:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.261029:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.261030:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.261033:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.261037:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078e7ed69/0xb5d1f3b1a1902659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.261048:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078e7ed69/0xb5d1f3b1a1902659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.261056:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078e7ed69/0xb5d1f3b1a1902659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.261063:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078e7ed69/0xb5d1f3b1a1902659 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.261084:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.261129:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.261135:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078e7ed69/0xb5d1f3b1a1902659 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.261143:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962e00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.261147:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078e7ed69/0xb5d1f3b1a1902659 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.261155:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078e7ed69/0xb5d1f3b1a1902659 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.261167:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078e7ed69/0xb5d1f3b1a1902659 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.261187:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078e7ed69/0xb5d1f3b1a1902659 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.261203:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.261205:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.261208:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604081.261834:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604081.261857:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501b2eea/0xb5d1f3b1a1902660 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.261866:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787604081.261870:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604081.261874:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000501b2eea/0xb5d1f3b1a1902660 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.261884:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000501b2eea/0xb5d1f3b1a1902660 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.261892:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501b2eea/0xb5d1f3b1a1902660 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.261905:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000501b2eea/0xb5d1f3b1a1902660 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.261924:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.261986:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.261993:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000501b2eea/0xb5d1f3b1a1902660 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.262002:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962800 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.262007:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000501b2eea/0xb5d1f3b1a1902660 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.262017:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000501b2eea/0xb5d1f3b1a1902660 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.262030:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000501b2eea/0xb5d1f3b1a1902660 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.262038:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000501b2eea/0xb5d1f3b1a1902660 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.262060:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.262062:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.262065:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604081.263808:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604081.263819:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902667 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.263832:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787604081.263856:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604081.263863:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902667 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.263875:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902667 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.263885:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902667 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.263893:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902667 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.263913:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.264322:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.264330:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902667 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.264339:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963600 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.264345:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902667 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.264354:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902667 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.264372:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902667 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787604081.264378:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604081.264380:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902667 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.264387:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e08efd82/0xb5d1f3b1a190266e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.264402:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.264403:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1787604081.264406:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.264408:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604081.264409:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604081.264415:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e08efd82/0xb5d1f3b1a190266e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.264424:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e08efd82/0xb5d1f3b1a190266e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.264432:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e08efd82/0xb5d1f3b1a190266e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.264438:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e08efd82/0xb5d1f3b1a190266e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604081.264463:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604081.267783:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604081.267799:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e08efd82/0xb5d1f3b1a190266e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.267814:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963a00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.267819:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e08efd82/0xb5d1f3b1a190266e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.267867:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e08efd82/0xb5d1f3b1a190266e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.267890:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e08efd82/0xb5d1f3b1a190266e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.267898:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e08efd82/0xb5d1f3b1a190266e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.267926:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.267928:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604081.267930:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604081.273139:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604081.273154:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902675 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.273174:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787604081.273179:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604081.273185:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.273202:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.273212:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.273220:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902675 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.273258:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787604081.273342:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604081.273349:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902675 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604081.273357:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5daca00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787604081.273361:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902675 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604081.273370:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604081.273398:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902675 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604081.273405:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902675 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604081.273421:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604081.273423:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604081.273425:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604081.275310:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604081.275322:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aee34708/0xb5d1f3b1a190267c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.275337:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787604081.275342:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604081.275348:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aee34708/0xb5d1f3b1a190267c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.275361:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aee34708/0xb5d1f3b1a190267c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.275370:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aee34708/0xb5d1f3b1a190267c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.275378:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aee34708/0xb5d1f3b1a190267c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.275454:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787604081.276323:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604081.276330:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6879dcc/0xb5d1f3b1a1902683 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.276341:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787604081.276349:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604081.276354:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6879dcc/0xb5d1f3b1a1902683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.276363:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6879dcc/0xb5d1f3b1a1902683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.276371:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6879dcc/0xb5d1f3b1a1902683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.276379:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6879dcc/0xb5d1f3b1a1902683 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.276593:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604081.276600:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aee34708/0xb5d1f3b1a190267c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.276609:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604081.276613:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aee34708/0xb5d1f3b1a190267c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.276622:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aee34708/0xb5d1f3b1a190267c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.276744:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604081.277003:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1787604081.277225:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604081.277232:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190268a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.277242:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787604081.277245:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604081.277250:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190268a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.277260:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190268a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.277269:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190268a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.277282:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190268a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.277291:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787604081.277945:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604081.277952:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a388674/0xb5d1f3b1a1902691 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.277961:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787604081.277964:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604081.277969:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a388674/0xb5d1f3b1a1902691 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.277978:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a388674/0xb5d1f3b1a1902691 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.277985:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a388674/0xb5d1f3b1a1902691 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.277993:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a388674/0xb5d1f3b1a1902691 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.278001:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1787604081.278172:0:15035:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:0.0:1787604081.278329:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aee34708/0xb5d1f3b1a190267c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604081.278349:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aee34708/0xb5d1f3b1a190267c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604081.278521:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14375:x1874438355251968:12345-0@lo:5:osp-pre-0-0.0 Request processed in 95179us (95385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604081.278537:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787604081.279032:0:15692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787604081.279038:0:15692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190268a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279058:0:15692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604081.279063:0:15692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190268a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279072:0:15692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190268a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279087:0:15692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190268a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279094:0:15692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a190268a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279112:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6879dcc/0xb5d1f3b1a1902683 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279118:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad400 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604081.279121:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6879dcc/0xb5d1f3b1a1902683 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279129:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6879dcc/0xb5d1f3b1a1902683 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279157:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6879dcc/0xb5d1f3b1a1902683 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279165:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6879dcc/0xb5d1f3b1a1902683 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279176:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604081.279179:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a388674/0xb5d1f3b1a1902691 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279185:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad800 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604081.279188:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a388674/0xb5d1f3b1a1902691 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279196:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a388674/0xb5d1f3b1a1902691 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279204:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a388674/0xb5d1f3b1a1902691 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279210:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a388674/0xb5d1f3b1a1902691 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604081.279220:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604081.279221:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604081.279227:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604081.279232:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604081.279233:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604081.279235:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604081.280011:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604081.280014:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604081.280016:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604081.281010:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14375:1874438355251968:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787604081.281027:0:14375:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787604081.281076:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14375:1874438355252096:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787604081.281192:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604081.281240:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286a96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787604081.281976:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355252096 00000100:00100000:3.0:1787604081.281985:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355252096 00000100:00100000:3.0:1787604081.282044:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787604081.282063:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14375:x1874438355252096:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787604081.282106:0:15033:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1787604081.295755:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14375:x1874438355252096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13687us (14555us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787604081.295769:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787604081.300268:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14375:1874438355252096:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787604081.300584:0:14375:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1787604082.138565:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787604082.284306:0:15754:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787604082.284310:0:15754:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787604082.284381:0:15754:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ed182409800 00000020:01000004:0.0:1787604082.284396:0:15754:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787604082.284409:0:15754:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787604082.284423:0:15754:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ed28654b370) 00000020:00000080:0.0:1787604082.284440:0:15754:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787604082.295427:0:15754:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787604082.295720:0:15754:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787604082.296271:0:15754:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787604082.296461:0:15754:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787604082.296679:0:15754:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787604082.297556:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 536: rc = 0 00100000:10000000:2.0:1787604082.297692:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 536: rc = 0 00100000:10000000:2.0:1787604082.297780:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 536: rc = 0 00100000:10000000:2.0:1787604082.298189:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1787604082.298358:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:2.0:1787604082.298567:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1787604082.298879:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1787604082.299061:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1787604082.299813:0:15754:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00000020:00000080:2.0:1787604082.300272:0:15754:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787604082.300283:0:15754:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787604082.300291:0:15754:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb5d1f3b1a190269f 00000020:01000004:2.0:1787604082.300298:0:15754:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787604082.300315:0:15754:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787604082.300318:0:15754:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787604082.300322:0:15754:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787604082.300337:0:15754:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787604082.300340:0:15754:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787604082.306026:0:15754:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787604082.306057:0:15754:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.121@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787604082.306060:0:15754:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787604082.306062:0:15754:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787604082.306063:0:15754:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604082.306063:0:15754:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604082.306067:0:15754:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604082.306068:0:15754:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604082.306069:0:15754:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787604082.306070:0:15754:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604082.306071:0:15754:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787604082.306074:0:15754:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787604082.306075:0:15754:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787604082.306076:0:15754:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787604082.306076:0:15754:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604082.306077:0:15754:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604082.306078:0:15754:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604082.306078:0:15754:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604082.306079:0:15754:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787604082.306079:0:15754:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604082.306080:0:15754:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787604082.306108:0:15754:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787604082.306123:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252224:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787604082.306176:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604082.306225:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355252224 00000100:00100000:0.0:1787604082.306237:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355252224 00000100:00100000:2.0:1787604082.306286:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed298533f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604082.306286:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787604082.306295:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+16:15754:x1874438355252224:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787604082.306323:0:14347:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787604082.306326:0:14347:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787604082.306330:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787604082.311498:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+16:15754:x1874438355252224:12345-0@lo:253:mount.lustre.0 Request processed in 5195us (5311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604082.311514:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787604082.311598:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252224:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787604082.311620:0:15754:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787604082.311623:0:15754:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787604082.311624:0:15754:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787604082.311625:0:15754:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604082.311626:0:15754:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604082.311627:0:15754:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604082.311627:0:15754:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604082.311629:0:15754:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787604082.311630:0:15754:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604082.311631:0:15754:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787604082.311653:0:15754:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ed182409800 from lustre-OST0001 10000000:01000000:2.0:1787604082.311690:0:15754:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787604082.311692:0:15754:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787604082.311699:0:15754:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ed2b6130000 local copy 00010000:00010000:2.0:1787604082.311708:0:15754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190244c expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604082.311997:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604082.312026:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604082.312057:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2985336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787604082.312099:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355252352 00000100:00100000:3.0:1787604082.312104:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355252352 00000100:00100000:3.0:1787604082.312137:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787604082.312146:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+16:15754:x1874438355252352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604082.312307:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+16:15754:x1874438355252352:12345-0@lo:501:mount.lustre.0 Request processed in 163us (280us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787604082.312313:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787604082.312715:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252352:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787604082.312726:0:15754:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787604082.312907:0:15754:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787604082.312913:0:15754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190244c expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604082.312920:0:15754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e200/0xb5d1f3b1a1902445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a190244c expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604082.312938:0:15754:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ed182409800 10000000:01000000:2.0:1787604082.312941:0:15754:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787604082.312945:0:15754:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787604082.312946:0:15754:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787604082.312949:0:15754:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787604082.312951:0:15754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787604082.312971:0:15754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962800/0xb5d1f3b1a19026a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604082.312976:0:15754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962800/0xb5d1f3b1a19026a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604082.312983:0:15754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962800/0xb5d1f3b1a19026a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604082.312999:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787604082.313022:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604082.313045:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2985336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604082.313062:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355252480 00000100:00100000:0.0:1787604082.313066:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355252480 00000100:00100000:0.0:1787604082.313098:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787604082.313105:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+16:15754:x1874438355252480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604082.313114:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604082.313126:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298594400/0xb5d1f3b1a19026ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19026a6 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604082.313150:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298594400/0xb5d1f3b1a19026ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19026a6 expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604082.313157:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298594400/0xb5d1f3b1a19026ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19026a6 expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604082.313163:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594400, rc 0) 00000100:00100000:0.0:1787604082.313193:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+17:15754:x1874438355252480:12345-0@lo:101:mount.lustre.0 Request processed in 88us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604082.313199:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787604082.313222:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604082.313234:0:15754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962800/0xb5d1f3b1a19026a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19026ad expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604082.313243:0:15754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962800/0xb5d1f3b1a19026a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19026ad expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787604082.313813:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787604082.314367:0:15754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787604082.314678:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787604082.314712:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787604082.314730:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787604082.314806:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787604082.314887:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787604082.314940:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787604082.314996:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787604082.315002:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787604082.315054:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604082.315095:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604082.315167:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed298533d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787604082.315196:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355252608 00000100:00100000:3.0:1787604082.315201:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355252608 00000100:00100000:3.0:1787604082.315234:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787604082.315243:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+17:15754:x1874438355252608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604082.315628:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+17:15754:x1874438355252608:12345-0@lo:501:mount.lustre.0 Request processed in 385us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604082.315644:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787604082.315706:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604082.315730:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787604082.315774:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604082.315803:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed298533d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787604082.315828:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355252736 00000100:00100000:1.0:1787604082.315833:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355252736 00000100:00100000:1.0:1787604082.315883:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787604082.315890:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+17:15754:x1874438355252736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787604082.316105:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+17:15754:x1874438355252736:12345-0@lo:503:mount.lustre.0 Request processed in 215us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604082.316112:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787604082.316128:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787604082.316706:0:15754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787604082.316756:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604082.316808:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604082.316900:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed298533d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787604082.316929:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355252864 00000100:00100000:3.0:1787604082.316932:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355252864 00000100:00100000:3.0:1787604082.316959:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787604082.316966:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+17:15754:x1874438355252864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787604082.317129:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+17:15754:x1874438355252864:12345-0@lo:502:mount.lustre.0 Request processed in 164us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604082.317135:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787604082.317186:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787604082.317316:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787604082.317343:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787604082.317360:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787604082.317448:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787604082.317473:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787604082.317490:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787604082.317578:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787604082.317598:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787604082.317635:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787604082.317660:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604082.317694:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604082.317711:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed298533d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787604082.317751:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355252992 00000100:00100000:0.0:1787604082.317756:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355252992 00000100:00100000:0.0:1787604082.317797:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787604082.317803:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+17:15754:x1874438355252992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604082.317944:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+17:15754:x1874438355252992:12345-0@lo:502:mount.lustre.0 Request processed in 140us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604082.317951:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787604082.317956:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355252992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787604082.318009:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787604082.318018:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787604082.318589:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787604082.318595:0:15755:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787604082.318599:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604082.318601:0:15755:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787604082.318604:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787604082.318617:0:15755:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ed2b50bb370) 00000020:00000080:2.0:1787604082.318643:0:15755:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787604082.318649:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787604082.318700:0:15755:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ed182409800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787604082.318705:0:15755:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787604082.318710:0:15755:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb5d1f3b1a19026bb 00010000:00010000:2.0:1787604082.321304:0:15755:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787604082.322334:0:15755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787604082.323665:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787604082.324594:0:15755:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787604082.324604:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604082.324610:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604082.324612:0:15755:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787604082.324615:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787604082.324619:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604082.324621:0:15755:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787604082.324623:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787604082.324625:0:15755:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787604082.324627:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604082.324629:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604082.324630:0:15755:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787604082.324632:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787604082.324634:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604082.324635:0:15755:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787604082.324638:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787604082.324681:0:15755:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604082.324684:0:15755:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604082.324686:0:15755:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787604082.324689:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787604082.324921:0:15754:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787604082.324948:0:15754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787604082.325004:0:15754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962800/0xb5d1f3b1a19026a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19026ad expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604082.325016:0:15754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962800/0xb5d1f3b1a19026a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19026ad expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604082.325024:0:15754:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed182409800 from 1 10000000:01000000:1.0:1787604082.325027:0:15754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787604082.325080:0:15754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604082.325088:0:15754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604082.325099:0:15754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604082.325121:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787604082.325184:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604082.325218:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28713b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787604082.325901:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355253120 00000100:00100000:2.0:1787604082.325914:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355253120 00000100:00100000:2.0:1787604082.325960:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787604082.325970:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+17:15754:x1874438355253120:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604082.325984:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604082.326003:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b4962e00/0xb5d1f3b1a19026c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19026c2 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604082.326026:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4962e00/0xb5d1f3b1a19026c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19026c2 expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604082.326037:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b4962e00/0xb5d1f3b1a19026c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19026c2 expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604082.326046:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962e00, rc 0) 00000100:00100000:2.0:1787604082.326103:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+18:15754:x1874438355253120:12345-0@lo:101:mount.lustre.0 Request processed in 134us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604082.326110:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787604082.326272:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604082.326289:0:15754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19026c9 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604082.326298:0:15754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19026c9 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787604082.327877:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787604082.328318:0:15754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787604082.328496:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787604082.328541:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787604082.328584:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787604082.328589:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787604082.330074:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604082.330127:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604082.330198:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28670a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604082.330341:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355253248 00000100:00100000:2.0:1787604082.330349:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355253248 00000100:00100000:2.0:1787604082.330489:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787604082.330508:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+18:15754:x1874438355253248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604082.330749:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+18:15754:x1874438355253248:12345-0@lo:501:mount.lustre.0 Request processed in 241us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604082.330757:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787604082.330865:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604082.330897:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787604082.330926:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604082.331125:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28713b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787604082.331150:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355253376 00000100:00100000:0.0:1787604082.331154:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355253376 00000100:00100000:0.0:1787604082.331180:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787604082.331185:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+18:15754:x1874438355253376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604082.331349:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+18:15754:x1874438355253376:12345-0@lo:503:mount.lustre.0 Request processed in 163us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604082.331355:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787604082.331465:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253376:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787604082.332267:0:15754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787604082.332319:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604082.332356:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604082.332423:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28713b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787604082.332560:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355253504 00000100:00100000:0.0:1787604082.332566:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355253504 00000100:00100000:0.0:1787604082.332638:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787604082.332647:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+18:15754:x1874438355253504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604082.332819:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+18:15754:x1874438355253504:12345-0@lo:502:mount.lustre.0 Request processed in 173us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604082.332827:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787604082.332942:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787604082.333121:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787604082.333152:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787604082.333179:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787604082.333198:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787604082.333214:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787604082.333250:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787604082.333268:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787604082.333284:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787604082.333302:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604082.333330:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604082.333478:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28713b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787604082.333507:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355253632 00000100:00100000:2.0:1787604082.333512:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355253632 00000100:00100000:2.0:1787604082.333535:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787604082.333541:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+18:15754:x1874438355253632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604082.333694:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf773450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+18:15754:x1874438355253632:12345-0@lo:502:mount.lustre.0 Request processed in 137us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604082.333724:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787604082.333810:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000100:00100000:2.0:1787604082.333854:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000040:00080000:1.0:1787604082.333914:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787604082.334596:0:15759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604082.334603:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604082.334605:0:15759:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787604082.334610:0:15759:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ed182409800 00000020:00000080:1.0:1787604082.334612:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787604082.334619:0:15759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604082.334621:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604082.334622:0:15759:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787604082.334625:0:15759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604082.334627:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604082.334628:0:15759:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787604082.334631:0:15759:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ed182409800 00000020:00000080:1.0:1787604082.334633:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787604082.334689:0:15759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604082.334692:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604082.334692:0:15759:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787604082.334694:0:15759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604082.334696:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604082.334697:0:15759:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787604082.334699:0:15759:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ed182409800 00000020:00000080:1.0:1787604082.334700:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787604082.334723:0:15759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604082.334725:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604082.334732:0:15759:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787604082.334734:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787604082.338186:0:15754:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787604082.338233:0:15754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787604082.338251:0:15754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19026c9 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604082.338264:0:15754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19026c9 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604082.338315:0:15754:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787604082.338318:0:15754:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ed182409800 10000000:01000000:2.0:1787604082.338322:0:15754:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ed182409800 10000000:01000000:2.0:1787604082.338326:0:15754:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787604082.338332:0:15754:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ed182409800 from 1 10000000:01000000:2.0:1787604082.338335:0:15754:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787604082.338370:0:15754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a19026d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604082.339576:0:15754:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a19026d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604082.339596:0:15754:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a19026d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604082.339622:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787604082.339689:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604082.339729:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286a9c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787604082.339818:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355253760 00000100:00100000:0.0:1787604082.339826:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355253760 00000100:00100000:0.0:1787604082.339899:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787604082.339909:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+18:15754:x1874438355253760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604082.339922:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604082.339937:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a19026d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19026d0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604082.339966:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a19026d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19026d0 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604082.339977:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298595200/0xb5d1f3b1a19026d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19026d0 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604082.339986:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595200, rc 0) 00000100:00100000:0.0:1787604082.340024:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+19:15754:x1874438355253760:12345-0@lo:101:mount.lustre.0 Request processed in 116us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604082.340030:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787604082.340591:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604082.340608:0:15754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a19026d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19026d7 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604082.340618:0:15754:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a19026d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a19026d7 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787604082.341203:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787604082.343776:0:15754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787604082.344065:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787604082.344094:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787604082.344111:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787604082.344136:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787604082.344155:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787604082.344178:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787604082.344197:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787604082.344214:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787604082.344237:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787604082.344267:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787604082.344285:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787604082.344310:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787604082.344328:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787604082.344345:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787604082.344367:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787604082.346666:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787604082.346758:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787604082.346867:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787604082.346908:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787604082.346944:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787604082.346994:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787604082.347032:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787604082.347067:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787604082.347118:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787604082.347156:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787604082.347209:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787604082.347272:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787604082.347313:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787604082.347348:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787604082.347994:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787604082.348039:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787604082.348072:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787604082.348103:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787604082.348146:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787604082.348176:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787604082.348219:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787604082.348253:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787604082.348348:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787604082.348356:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787604082.349653:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604082.349721:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604082.349781:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286a9c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787604082.349857:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355253888 00000100:00100000:3.0:1787604082.349865:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355253888 00000100:00100000:3.0:1787604082.349918:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787604082.349929:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+19:15754:x1874438355253888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604082.350171:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+19:15754:x1874438355253888:12345-0@lo:501:mount.lustre.0 Request processed in 244us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604082.350179:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787604082.350553:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355253888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604082.350579:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355254016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787604082.350611:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604082.350644:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286a9c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787604082.350708:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355254016 00000100:00100000:3.0:1787604082.350712:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355254016 00000100:00100000:3.0:1787604082.350829:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787604082.350855:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+19:15754:x1874438355254016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787604082.351002:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf772450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+19:15754:x1874438355254016:12345-0@lo:503:mount.lustre.0 Request processed in 165us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604082.351009:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787604082.351055:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355254016:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787604082.351992:0:15754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787604082.352088:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355254144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787604082.352156:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604082.352186:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355254144 00000100:00100000:3.0:1787604082.352192:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355254144 00000100:00100000:3.0:1787604082.352223:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787604082.352229:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+19:15754:x1874438355254144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787604082.352404:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf770050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+19:15754:x1874438355254144:12345-0@lo:502:mount.lustre.0 Request processed in 174us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604082.352411:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787604082.352922:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28965c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604082.352943:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355254144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787604082.353199:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787604082.353254:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787604082.353290:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787604082.353344:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787604082.354573:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787604082.354674:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787604082.354712:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787604082.354740:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787604082.354799:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787604082.354857:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787604082.354901:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787604082.354943:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787604082.354974:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787604082.355002:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787604082.355043:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787604082.355077:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787604082.355104:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787604082.355143:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787604082.355173:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787604082.355201:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787604082.355252:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787604082.355301:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787604082.355330:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787604082.355367:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787604082.356739:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787604082.356805:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787604082.357155:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787604082.357188:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787604082.357208:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787604082.357254:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787604082.357275:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787604082.357291:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787604082.357307:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787604082.357331:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787604082.357349:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787604082.357372:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787604082.357943:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787604082.357967:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787604082.357996:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787604082.358015:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787604082.358054:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355254272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604082.358119:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604082.358154:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28670a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787604082.358274:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355254272 00000100:00100000:2.0:1787604082.358280:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355254272 00000100:00100000:2.0:1787604082.358320:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787604082.358330:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+19:15754:x1874438355254272:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604082.358651:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+19:15754:x1874438355254272:12345-0@lo:502:mount.lustre.0 Request processed in 322us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604082.358659:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787604082.358729:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355254272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604082.358812:0:15754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787604082.358823:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787604082.360713:0:15764:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787604082.360727:0:15764:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ed2865499b8) 00000020:00000080:0.0:1787604082.360749:0:15764:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787604082.361131:0:15764:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ed182409800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787604082.361135:0:15764:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ed182409800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787604082.361137:0:15764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ed182409800 3 00010000:00080000:0.0:1787604082.361162:0:15764:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ed182998000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.121@tcp at head 00010000:00010000:0.0:1787604082.362982:0:15764:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787604082.363180:0:15764:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787604082.363209:0:15764:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787604082.363219:0:15764:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb5d1f3b1a19026e5 00000100:00080000:0.0:1787604082.363228:0:15764:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787604082.363232:0:15764:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ed182998000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:0.0:1787604082.363261:0:15764:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2b9df5f80 x1874438355254400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787604082.363283:0:15764:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787604082.363351:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604082.363356:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787604082.363358:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ed1835bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604082.363362:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 414 00000100:00080000:3.0:1787604082.363366:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787604082.363369:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ed1835bb000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:3.0:1787604082.363383:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2bf6db100 x1874438355254656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787604082.363430:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355254528:0@lo:400:kworker.0 00000100:00100000:3.0:1787604082.363495:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787604082.363519:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1787604082.363538:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355254912:0@lo:400:kworker.0 00000100:00100000:3.0:1787604082.363567:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604082.363584:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787604082.363589:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355254784:0@lo:400:kworker.0 00000100:00100000:3.0:1787604082.363627:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604082.363656:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355254528 00000100:00100000:0.0:1787604082.363656:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355254912 00000100:00100000:3.0:1787604082.363662:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355254528 00000100:00100000:0.0:1787604082.363662:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355254912 00000100:00100000:0.0:1787604082.363696:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355254784 00000100:00100000:0.0:1787604082.363698:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355254784 00000100:00100000:3.0:1787604082.363699:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787604082.363706:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355254528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604082.363710:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787604082.363715:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355254912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604082.363753:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874438355254912:12345-0@lo:400:kworker.0 Request processed in 36us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604082.363760:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3284:x1874438355254528:12345-0@lo:400:kworker.0 Request processed in 54us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604082.363760:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787604082.364096:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787604082.364118:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787604082.364127:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355254784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604082.364166:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355254528:0@lo:400:kworker.0 00010000:00080000:3.0:1787604082.365704:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2bf6d9880 x1874438355254912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604082.365722:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3282:1874438355254912:0@lo:400:kworker.0 00010000:00080000:3.0:1787604082.366549:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2bf6d8a80 x1874438355254784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604082.366562:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355254784:0@lo:400:kworker.0 00000100:00100000:0.0:1787604082.366582:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355254784:12345-0@lo:400:kworker.0 Request processed in 2455us (2952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604082.366594:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787604082.366688:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874438355254400:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787604082.366732:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604082.366780:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355254656:0@lo:8:kworker.0 00000100:00100000:2.0:1787604082.366805:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604082.366856:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355254400 00000100:00100000:3.0:1787604082.366864:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355254400 00000020:01000000:2.0:1787604082.366865:0:15754:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:3.0:1787604082.366894:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 10000000:01000000:2.0:1787604082.366900:0:15754:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:3.0:1787604082.366901:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3280:x1874438355254400:12345-0@lo:38:llog_process_th.0 00010000:00010000:2.0:1787604082.366918:0:15754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a19026d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19026d7 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787604082.366926:0:14354:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 415 last 0 00010000:00010000:2.0:1787604082.366928:0:15754:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2b4962200/0xb5d1f3b1a19026d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a19026d7 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787604082.366960:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb5d1f3b1a19026ec 00000020:01000004:2.0:1787604082.366970:0:15754:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787604082.366972:0:15754:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000004:00100000:3.0:1787604082.366973:0:14354:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000004:2.0:1787604082.366974:0:15754:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604082.366975:0:15754:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604082.366976:0:15754:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604082.366977:0:15754:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604082.366978:0:15754:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787604082.366980:0:15754:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604082.366981:0:15754:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787604082.366985:0:15754:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787604082.366988:0:15754:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787604082.366989:0:15754:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787604082.366990:0:15754:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604082.366991:0:15754:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604082.366992:0:15754:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604082.366992:0:15754:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604082.366993:0:15754:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787604082.366995:0:15754:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604082.366996:0:15754:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:3.0:1787604082.367004:0:14354:0:(import.c:65:import_set_state_nolock()) ffff9ed2b5fdf000 : changing import state from RECOVER to FULL 10000000:01000000:2.0:1787604082.367013:0:15754:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787604082.367025:0:15754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355255040:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787604082.367049:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874438355254400:12345-0@lo:38:llog_process_th.0 Request processed in 146us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604082.367055:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787604082.367057:0:15754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604082.367074:0:15754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286a9ccc0 going to sleep for 11 seconds 00010000:00080000:3.0:1787604082.367087:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ed2b9df5f80 x1874438355254400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787604092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604082.367106:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787604082.367113:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787604082.367120:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787604082.367126:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787604082.367128:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed182998000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787604082.367134:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3280:1874438355254400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787604082.367152:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355254656 00000100:00100000:0.0:1787604082.367157:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355254656 00000100:00100000:0.0:1787604082.367182:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787604082.367187:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874438355254656:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787604082.367231:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3280:x1874438355254656:12345-0@lo:8:kworker.0 Request processed in 43us (424us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787604082.367237:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787604082.367248:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787604082.367252:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed1835bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787604082.367256:0:3280:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787604082.367258:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355255040 00000100:00100000:3.0:1787604082.367259:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355254656:0@lo:8:kworker.0 00000100:00100000:0.0:1787604082.367261:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355255040 00000100:00100000:0.0:1787604082.367284:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787604082.367291:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+19:15754:x1874438355255040:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787604082.367309:0:14347:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787604082.367321:0:14347:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787604082.382250:0:14347:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787604082.382289:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787604082.382330:0:14368:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787604082.382335:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787604082.382357:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604082.382375:0:14368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19025c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19025bf expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604082.382543:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604082.382585:0:14368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19025c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19025bf expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604082.382614:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19025c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19025bf expref: 19 pid: 14345 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604082.382629:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14368:1874438355255168:0@lo:104: 00000100:00100000:0.0:1787604082.382694:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604082.382791:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295245f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787604082.382895:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355255168 00000100:00100000:1.0:1787604082.382903:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355255168 00000100:00100000:1.0:1787604082.382975:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787604082.382986:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e30912c-ffd9-4190-a569-23df3a025820+3:14368:x1874438355255168:12345-0@lo:104: 00010000:00010000:1.0:1787604082.382998:0:14336:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19025c6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604082.383051:0:14336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787604082.383057:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e30912c-ffd9-4190-a569-23df3a025820+3:14368:x1874438355255168:12345-0@lo:104: Request processed in 74us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604082.383064:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787604082.383112:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14368:1874438355255168:0@lo:104: 00010000:00010000:0.0:1787604082.383131:0:14368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.383816:0:15692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604082.383824:0:15692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19025c6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.383833:0:15692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298595800 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787604082.383853:0:15692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19025c6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.383863:0:15692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19025c6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604082.383871:0:15692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19025c6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604082.383877:0:15692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787604082.383912:0:15692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19025c6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.383928:0:15692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787604082.383956:0:15692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19025c6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.383964:0:15692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19025bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19025c6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.383980:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604082.383982:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604082.383983:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604082.384028:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787604082.384042:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e30912c-ffd9-4190-a569-23df3a025820:3284:1874438355255296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787604082.384084:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604082.384129:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355255296 00000100:00100000:3.0:1787604082.384135:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355255296 00010000:00010000:3.0:1787604082.384158:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19025c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19025bf expref: 20 pid: 14345 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604082.384218:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787604082.384227:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e30912c-ffd9-4190-a569-23df3a025820+20:3284:x1874438355255296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787604082.384239:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604082.384245:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19025c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19025bf expref: 20 pid: 14345 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.384256:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19025c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19025bf expref: 20 pid: 14345 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.384269:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a19025c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19025bf expref: 20 pid: 14345 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.384282:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.384299:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787604082.384312:0:14339:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001978066s 00010000:00010000:3.0:1787604082.384317:0:14339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.384324:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.384331:0:14339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.384338:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.384343:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604082.384347:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.384354:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.384375:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604082.384394:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787604082.384417:0:14368:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604082.384425:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604082.384430:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e30912c-ffd9-4190-a569-23df3a025820+19:3284:x1874438355255296:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (346us total) trans 0 rc 0/0 00010000:00010000:0.0:1787604082.384432:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a19026f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604082.384437:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787604082.384460:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e30912c-ffd9-4190-a569-23df3a025820:3284:1874438355255296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604082.388002:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+18:15754:x1874438355255040:12345-0@lo:253:mount.lustre.0 Request processed in 20700us (20933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604082.388017:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787604082.388027:0:15754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e30912c-ffd9-4190-a569-23df3a025820:15754:1874438355255040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787604082.388043:0:15754:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787604082.388046:0:15754:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787604082.388048:0:15754:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787604082.388049:0:15754:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604082.388050:0:15754:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604082.388066:0:15754:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604082.388068:0:15754:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604082.388070:0:15754:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787604082.388072:0:15754:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604082.388073:0:15754:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787604082.388091:0:15754:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787604082.391451:0:15754:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787604082.391580:0:15754:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787604082.391692:0:15754:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787604082.391826:0:15754:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787604082.391957:0:15754:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787604082.392110:0:15754:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787604082.392805:0:15754:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787604082.423905:0:15754:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787604082.423914:0:15754:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787604082.423944:0:15754:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787604082.423998:0:15754:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787604082.424011:0:15754:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787604082.424047:0:15754:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787604083.159756:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787604084.058012:0:14349:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787604084.058019:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ed283965800 from 8 10000000:01000000:0.0:1787604084.058025:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787604084.058080:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19026fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604084.058095:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19026fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604084.058106:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19026fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604084.058137:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355255424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787604084.058214:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604084.058270:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2b5c7f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787604084.059691:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355255424 00000100:00100000:3.0:1787604084.059702:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355255424 00000100:00100000:3.0:1787604084.059763:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787604084.059772:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+18:14349:x1874438355255424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787604084.059788:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604084.059807:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b5dad400/0xb5d1f3b1a1902701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a19026fa expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604084.059832:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b5dad400/0xb5d1f3b1a1902701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a19026fa expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604084.059869:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b5dad400/0xb5d1f3b1a1902701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19026fa expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604084.059875:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b5dad400, rc 0) 00000100:00100000:3.0:1787604084.059929:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+19:14349:x1874438355255424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604084.059934:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787604084.059978:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355255424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787604084.059994:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19026fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902701 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604084.060015:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19026fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1902701 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604084.060061:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355255552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787604084.060086:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604084.060112:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787604084.060173:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355255552 00000100:00100000:0.0:1787604084.060176:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355255552 00000100:00100000:0.0:1787604084.060199:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787604084.060204:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+19:14349:x1874438355255552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787604084.060213:0:14346:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787604084.060227:0:14346:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787604084.060229:0:14346:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787604084.060280:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+19:14349:x1874438355255552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604084.060284:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787604084.060585:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355255552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787604084.060628:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787604084.060632:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19026fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902701 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604084.060638:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed298595800/0xb5d1f3b1a19026fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902701 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604084.186980:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787604084.780301:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787604084.780331:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1787604085.207301:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604086.232959:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787604086.232984:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355255680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787604086.233055:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787604086.233055:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604086.233120:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355255680 00000100:00100000:1.0:1787604086.233128:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355255680 00000100:00100000:1.0:1787604086.233193:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787604086.233203:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355255680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787604086.233236:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604086.233277:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355255680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604086.233291:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787604086.233334:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787604086.233355:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355255680:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787604086.233500:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787604087.255017:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787604087.769477:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604087.769483:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787604087.769493:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ed1835bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787604087.769506:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ed1835bb000 using connection 192.168.202.121@tcp/0@lo 00000100:00100000:0.0:1787604087.769529:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ed2b9df4a80 x1874438355256064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787604087.769705:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e30912c-ffd9-4190-a569-23df3a025820:3281:1874438355255808:0@lo:400:kworker.0 00000100:00100000:3.0:1787604087.769785:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604087.769856:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787604087.769862:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355255936:0@lo:400:kworker.0 00000100:00100000:3.0:1787604087.769890:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604087.769919:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355256064:0@lo:8:kworker.0 00000100:00100000:3.0:1787604087.769940:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604087.769968:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355255808 00000100:00100000:3.0:1787604087.769974:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355255808 00000100:00100000:3.0:1787604087.770015:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787604087.770023:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+19:3281:x1874438355255808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604087.770075:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+19:3281:x1874438355255808:12345-0@lo:400:kworker.0 Request processed in 51us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604087.770082:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787604087.770112:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355255936 00000100:00100000:3.0:1787604087.770116:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355255936 00000100:00100000:3.0:1787604087.770138:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355256064 00000100:00100000:3.0:1787604087.770141:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355256064 00000100:00100000:3.0:1787604087.770152:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787604087.770158:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355255936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604087.770187:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355255936:12345-0@lo:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604087.770193:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787604087.770203:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787604087.770207:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3280:x1874438355256064:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787604087.770230:0:15036:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 420 last 0 00000100:00100000:0.0:1787604087.770390:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355256192:0@lo:400:kworker.0 00000100:00100000:0.0:1787604087.770419:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604087.770437:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787604087.770443:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355256320:0@lo:400:kworker.0 00000100:00100000:0.0:1787604087.770462:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604087.770484:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355256192 00000100:00100000:0.0:1787604087.770488:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355256192 00000100:00100000:0.0:1787604087.770511:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355256320 00000100:00100000:0.0:1787604087.770514:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355256320 00000100:00100000:0.0:1787604087.770534:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787604087.770539:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355256192:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787604087.771686:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787604087.771851:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355256192:12345-0@lo:400:kworker.0 Request processed in 1293us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604087.771862:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787604087.771891:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787604087.771903:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355256320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604087.771951:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355256320:12345-0@lo:400:kworker.0 Request processed in 53us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604087.771958:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787604087.771997:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b9df6300 x1874438355256320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604087.772011:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355256320:0@lo:400:kworker.0 00010000:00080000:0.0:1787604087.772033:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b9df6680 x1874438355256192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604087.772041:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355256192:0@lo:400:kworker.0 00000020:00000080:3.0:1787604087.772324:0:15036:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb5d1f3b1a1902708 00002000:00100000:3.0:1787604087.772342:0:15036:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ed182264800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787604087.772346:0:15036:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787604087.772349:0:15036:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787604087.773539:0:15036:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787604087.773582:0:15036:0:(import.c:65:import_set_state_nolock()) ffff9ed182267800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787604087.774511:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1874438355256064:12345-0@lo:8:kworker.0 Request processed in 4298us (4565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604087.774524:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787604087.774790:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787604087.774807:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355256448:0@lo:400:kworker.0 00000100:00100000:3.0:1787604087.774874:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604087.774912:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355256448 00000100:00100000:3.0:1787604087.774919:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355256448 00000100:00100000:3.0:1787604087.774965:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787604087.774974:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355256448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604087.775014:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355256448:12345-0@lo:400:kworker.0 Request processed in 41us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604087.775020:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787604087.775052:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b9df6a00 x1874438355256448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604087.775066:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355256448:0@lo:400:kworker.0 00000100:00080000:3.0:1787604087.775085:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787604087.776874:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2b9df4a80 x1874438355256064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787604112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787604087.776894:0:3280:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787604087.776902:0:3280:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787604087.776907:0:3280:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787604087.776911:0:3280:0:(import.c:65:import_set_state_nolock()) ffff9ed1835bb000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787604087.776929:0:3280:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787604087.776935:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3280:1874438355256064:0@lo:8:kworker.0 00000004:00080000:2.0:1787604087.777007:0:14377:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787604087.777028:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14377:1874438355256704:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787604087.777077:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604087.777917:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355256576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787604087.777973:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604087.778032:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355256576 00000100:00100000:3.0:1787604087.778039:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355256576 00000100:00100000:3.0:1787604087.778092:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787604087.778101:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1874438355256576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787604087.778140:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604087.778472:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1874438355256576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 370us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604087.778480:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787604087.778508:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787604087.778533:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ed2c1ec7800 x1874438355256576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787604103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604087.778552:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355256576:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1787604087.780070:0:14376:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787604087.780566:0:14376:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420844727755ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787604087.781945:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355256704 00000100:00100000:1.0:1787604087.781958:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355256704 00000100:00100000:1.0:1787604087.782004:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787604087.782012:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14377:x1874438355256704:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787604087.784684:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed295245300 going to sleep for 11 seconds 00000100:00100000:1.0:1787604087.788162:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355255936:0@lo:400:kworker.0 00000100:00100000:1.0:1787604087.788181:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e30912c-ffd9-4190-a569-23df3a025820:3281:1874438355255808:0@lo:400:kworker.0 00002000:00080000:1.0:1787604087.789341:0:15035:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787604087.789351:0:15035:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787604087.789357:0:15035:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1787604087.805150:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787604087.805161:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b86e448/0xb5d1f3b1a190270f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805177:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1787604087.805182:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787604087.805188:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b86e448/0xb5d1f3b1a190270f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805203:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b86e448/0xb5d1f3b1a190270f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805225:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b86e448/0xb5d1f3b1a190270f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805232:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b86e448/0xb5d1f3b1a190270f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805256:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787604087.805695:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787604087.805702:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1902716 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805710:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1787604087.805713:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787604087.805729:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1902716 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805739:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1902716 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805746:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1902716 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805753:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1902716 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805783:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787604087.805795:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787604087.805801:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b86e448/0xb5d1f3b1a190270f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805808:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787604087.805813:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b86e448/0xb5d1f3b1a190270f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805821:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b86e448/0xb5d1f3b1a190270f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805862:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b86e448/0xb5d1f3b1a190270f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805872:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b86e448/0xb5d1f3b1a190270f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805888:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604087.805892:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1902716 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805898:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f400 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787604087.805901:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1902716 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805918:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1902716 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805929:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1902716 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805937:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a962a12/0xb5d1f3b1a1902716 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.805951:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604087.805953:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604087.805955:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787604087.806341:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787604087.806347:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a190271d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.806354:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1787604087.806358:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787604087.806362:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a190271d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.806370:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a190271d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.806377:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a190271d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.806391:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a190271d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.806406:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787604087.806414:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604087.806419:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a190271d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.806425:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e400 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787604087.806429:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a190271d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.806438:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a190271d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.806449:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a190271d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.806456:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a99b0287/0xb5d1f3b1a190271d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.806470:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604087.806471:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604087.806473:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.807946:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604087.815592:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604087.815672:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902724 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.815691:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=420s v=(0 0) 00010000:00010000:2.0:1787604087.815696:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604087.815704:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902724 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.815744:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902724 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.815756:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902724 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.815764:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902724 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.817877:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787604087.818466:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.818476:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a190272b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.818493:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.818498:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.818504:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a190272b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.818518:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a190272b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.818528:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a190272b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.818536:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a190272b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.818568:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787604087.818945:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.818950:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902732 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.818958:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.818961:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.818972:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902732 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.818981:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902732 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.818989:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902732 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.818996:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902732 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819011:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787604087.819024:0:15692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787604087.819030:0:15692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902724 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819038:0:15692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963600 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604087.819043:0:15692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902724 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819052:0:15692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902724 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819067:0:15692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902724 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819084:0:15692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e29c5ce/0xb5d1f3b1a1902724 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819102:0:15692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787604087.819106:0:15692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a190272b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819111:0:15692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad800 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604087.819114:0:15692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a190272b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819121:0:15692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a190272b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819130:0:15692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a190272b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819136:0:15692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a190272b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819148:0:15692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604087.819151:0:15692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902732 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819156:0:15692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604087.819165:0:15692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902732 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819173:0:15692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902732 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819183:0:15692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902732 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819191:0:15692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902732 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819204:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.819205:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.819207:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604087.819601:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.819607:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a1902739 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819616:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.819620:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.819624:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a1902739 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819632:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a1902739 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819639:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a1902739 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819651:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a1902739 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819665:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604087.819673:0:15692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604087.819676:0:15692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a1902739 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819682:0:15692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dacc00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604087.819685:0:15692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a1902739 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819692:0:15692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a1902739 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819703:0:15692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a1902739 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819709:0:15692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a1902739 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.819736:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.819738:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.819740:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604087.819798:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604087.820152:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.820166:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902740 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820174:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.820177:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.820181:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902740 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820189:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902740 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820196:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902740 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820203:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902740 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820215:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604087.820223:0:15692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604087.820227:0:15692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902740 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820233:0:15692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad000 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604087.820237:0:15692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902740 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820245:0:15692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902740 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820262:0:15692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902740 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820269:0:15692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902740 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820282:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.820283:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.820286:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604087.820646:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.820652:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a1902747 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820660:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.820663:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.820667:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a1902747 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820675:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a1902747 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820683:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a1902747 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.820690:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a1902747 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.822208:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787604087.822780:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.822789:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a190274e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.822803:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.822808:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.822814:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a190274e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.822826:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a190274e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.822853:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a190274e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.822861:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a190274e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.823456:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604087.823464:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a1902747 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.823473:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dace00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604087.823478:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a1902747 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.823489:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a1902747 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.823510:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a1902747 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.823517:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a1902747 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.823537:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604087.823540:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a190274e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.823546:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad600 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604087.823549:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a190274e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.823675:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a190274e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.823687:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a190274e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.823695:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.823697:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.823698:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.823782:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787604087.823788:0:15035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a190274e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787604087.824301:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.824308:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a1902755 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.824323:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.824326:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.824331:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a1902755 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.824414:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a1902755 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.824424:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a1902755 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.824431:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a1902755 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.824449:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604087.824461:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604087.824464:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a1902755 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.824471:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604087.824475:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a1902755 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.824483:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a1902755 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.824506:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a1902755 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.824513:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a1902755 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.824528:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.824530:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.824532:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604087.825179:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.825186:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a190275c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.825195:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.825198:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.825202:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a190275c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.825210:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a190275c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.825219:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a190275c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.825225:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a190275c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.825252:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604087.825260:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604087.825264:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a190275c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.825271:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5daca00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604087.825276:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a190275c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.825284:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a190275c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.825296:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a190275c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.825302:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a190275c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.825315:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.825317:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.825319:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604087.826120:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.826128:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a1902763 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.826139:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.826150:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.826155:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a1902763 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.826165:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a1902763 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.826174:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a1902763 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.826181:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a1902763 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.826198:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604087.826210:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604087.826214:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a1902763 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.826220:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dada00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604087.826225:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a1902763 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.826232:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a1902763 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.826243:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a1902763 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.826523:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.831911:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a1902763 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.831962:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.831965:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.831967:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604087.835760:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.835774:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a190276a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.835791:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.835796:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.835803:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a190276a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.835817:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a190276a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.835826:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a190276a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.835834:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a190276a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.835868:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787604087.836328:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.836626:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902771 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.836638:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.836642:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.836647:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902771 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.836656:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902771 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.836665:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902771 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.836673:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902771 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.836688:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787604087.836693:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787604087.836696:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604087.836700:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a190276a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.836701:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902771 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.836710:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787604087.836710:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dacc00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604087.836715:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902771 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.836715:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a190276a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.836735:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a190276a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.836740:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902771 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.836751:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a190276a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.836755:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902771 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604087.836759:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a190276a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.836762:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025cf4fa5/0xb5d1f3b1a1902771 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.836777:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604087.836777:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.836779:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604087.836779:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.836781:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604087.836781:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604087.837212:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.837217:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a1902778 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.837225:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.837228:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.837233:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a1902778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.837241:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a1902778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.837249:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a1902778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.837256:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a1902778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.837275:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787604087.840737:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.840751:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078231467/0xb5d1f3b1a190277f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840768:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.840772:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.840778:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078231467/0xb5d1f3b1a190277f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840790:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078231467/0xb5d1f3b1a190277f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840800:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078231467/0xb5d1f3b1a190277f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840807:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078231467/0xb5d1f3b1a190277f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840825:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787604087.840849:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787604087.840855:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a1902778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840863:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad800 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604087.840873:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a1902778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840883:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a1902778 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840898:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a1902778 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840905:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a388674/0xb5d1f3b1a1902778 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840925:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604087.840928:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078231467/0xb5d1f3b1a190277f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840935:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac000 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604087.840938:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078231467/0xb5d1f3b1a190277f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840945:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078231467/0xb5d1f3b1a190277f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840954:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078231467/0xb5d1f3b1a190277f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840961:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078231467/0xb5d1f3b1a190277f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.840980:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.840981:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.840983:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.844479:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.844518:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604087.848819:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.848853:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902786 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.848871:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.848876:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.848883:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902786 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.848897:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902786 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.848908:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902786 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.848915:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902786 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.848935:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604087.849050:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604087.849059:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902786 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.849067:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad000 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604087.849071:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902786 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.849079:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902786 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.849098:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902786 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.849105:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f337b892/0xb5d1f3b1a1902786 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.849133:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604087.849136:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604087.849138:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787604087.852265:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787604087.854424:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.854438:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a190278d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.854467:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.854472:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.854479:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a190278d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.854492:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a190278d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.854503:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a190278d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.854511:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a190278d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.854646:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787604087.855226:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.855233:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902794 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.855242:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.855257:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.855262:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.855272:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.855292:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.855300:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.855745:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787604087.855754:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a190278d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.855763:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dada00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604087.855768:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a190278d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.855778:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a190278d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.855796:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a190278d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.855804:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc459a3b/0xb5d1f3b1a190278d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.855822:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604087.855826:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.855831:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5daca00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604087.855952:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:3.0:1787604087.856424:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.856430:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a190279b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.856440:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.856443:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.856448:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a190279b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.856457:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a190279b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.856464:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a190279b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.856471:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a190279b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.856526:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.856535:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.856547:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902794 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.856553:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bdb3d19/0xb5d1f3b1a1902794 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.856576:0:14340:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604087.856579:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a190279b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.856586:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dac200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:2.0:1787604087.856589:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a190279b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.856596:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a190279b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.856604:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a190279b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604087.856610:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604087.856615:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.856833:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.856914:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787604087.856920:0:15035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee34708/0xb5d1f3b1a190279b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787604087.857391:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.857397:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a19027a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.857407:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.857411:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.857415:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a19027a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.857425:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a19027a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.857434:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a19027a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.857442:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a19027a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.857455:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787604087.858072:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.858081:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a19027a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.858097:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.858101:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.858106:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a19027a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.858116:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a19027a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.858125:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a19027a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.858132:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a19027a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.858142:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787604087.858740:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.858751:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a19027b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.858761:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.858764:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.858768:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a19027b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.858777:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a19027b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.858796:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a19027b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.858803:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a19027b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.858811:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787604087.859206:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.859212:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003338427c/0xb5d1f3b1a19027b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.859220:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.859227:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.859231:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003338427c/0xb5d1f3b1a19027b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.859238:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003338427c/0xb5d1f3b1a19027b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.859542:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003338427c/0xb5d1f3b1a19027b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.859553:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003338427c/0xb5d1f3b1a19027b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859689:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787604087.859697:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a19027a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859706:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dad600 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604087.859711:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a19027a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859731:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a19027a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859749:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a19027a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859771:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d472baf3/0xb5d1f3b1a19027a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859793:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604087.859796:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a19027a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859802:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dace00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604087.859805:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a19027a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859812:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a19027a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859823:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a19027a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859829:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c6c0d85/0xb5d1f3b1a19027a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859857:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604087.859860:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a19027b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859865:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dacc00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604087.859875:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a19027b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859881:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a19027b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859891:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a19027b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859896:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b15a79e3/0xb5d1f3b1a19027b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.859907:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.859908:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.859910:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.859917:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604087.859996:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604087.860323:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604087.860328:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003338427c/0xb5d1f3b1a19027b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.860346:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217ca00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604087.860350:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003338427c/0xb5d1f3b1a19027b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.860358:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003338427c/0xb5d1f3b1a19027b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.860370:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003338427c/0xb5d1f3b1a19027b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.860384:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003338427c/0xb5d1f3b1a19027b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.860400:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.860402:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.860404:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604087.860827:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.860834:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019b2d4b3/0xb5d1f3b1a19027be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.860874:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.860878:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.860883:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b2d4b3/0xb5d1f3b1a19027be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.860893:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019b2d4b3/0xb5d1f3b1a19027be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.860901:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019b2d4b3/0xb5d1f3b1a19027be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.860908:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019b2d4b3/0xb5d1f3b1a19027be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.860923:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604087.861327:0:15692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604087.861397:0:15692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019b2d4b3/0xb5d1f3b1a19027be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.861406:0:15692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217cc00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604087.861409:0:15692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b2d4b3/0xb5d1f3b1a19027be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.861417:0:15692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b2d4b3/0xb5d1f3b1a19027be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.861429:0:15692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019b2d4b3/0xb5d1f3b1a19027be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.861437:0:15692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019b2d4b3/0xb5d1f3b1a19027be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.861452:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.861454:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.861455:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604087.861514:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604087.861655:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604087.861661:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6da930b/0xb5d1f3b1a19027c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.861670:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787604087.861679:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604087.861684:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6da930b/0xb5d1f3b1a19027c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.861693:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6da930b/0xb5d1f3b1a19027c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.861700:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6da930b/0xb5d1f3b1a19027c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.861707:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6da930b/0xb5d1f3b1a19027c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604087.861763:0:15035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787604087.861961:0:15035:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1787604087.862057:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14377:x1874438355256704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 80041us (84975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604087.862066:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787604087.862178:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14377:1874438355256704:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787604087.862195:0:14377:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787604087.862237:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14377:1874438355256832:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787604087.862411:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604087.862452:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed298921cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787604087.862500:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355256832 00000100:00100000:3.0:1787604087.862508:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355256832 00000100:00100000:3.0:1787604087.862566:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787604087.862577:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14377:x1874438355256832:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787604087.862615:0:15033:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1787604087.866028:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604087.866044:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6da930b/0xb5d1f3b1a19027c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.866059:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217d000 already unused, calling callback (ffffffffc1816230) 00010000:00010000:0.0:1787604087.866065:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6da930b/0xb5d1f3b1a19027c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.866076:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6da930b/0xb5d1f3b1a19027c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.866096:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6da930b/0xb5d1f3b1a19027c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.866103:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6da930b/0xb5d1f3b1a19027c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604087.866126:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.866127:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604087.866129:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604087.875745:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14377:x1874438355256832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13157us (13323us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787604087.875761:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787604087.876010:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2c1ec5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14377:1874438355256832:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787604087.876029:0:14377:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:02000400:2.0:1787604088.159725:0:16112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg221-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787604088.279026:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787604088.535892:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787604089.303306:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604090.346076:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604090.546828:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604090.546977:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345826304 00000100:00100000:1.0:1787604090.546987:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345826304 00000100:00100000:1.0:1787604090.547041:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 75 00000100:00100000:1.0:1787604090.547050:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2362:x1874438345826304:12345-192.168.202.21@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787604090.547078:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c33d6c8a-c34b-49f6-b7db-7724c3e70a96@192.168.202.21@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:1.0:1787604090.547107:0:14347:0:(genops.c:1385:class_connect()) connect: client c33d6c8a-c34b-49f6-b7db-7724c3e70a96, cookie 0xb5d1f3b1a19027cc 00000100:00080000:1.0:1787604090.547264:0:14347:0:(import.c:65:import_set_state_nolock()) ffff9ed2a4660000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787604090.547346:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+5:2362:x1874438345826304:12345-192.168.202.21@tcp:250:mount.lustre.0 Request processed in 296us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604090.547355:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 75 00000100:00100000:3.0:1787604090.566062:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604090.566220:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345826432 00000100:00100000:1.0:1787604090.566230:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345826432 00000100:00100000:1.0:1787604090.566290:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 76 00000100:00100000:1.0:1787604090.566315:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+5:13750:x1874438345826432:12345-192.168.202.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787604090.566331:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604090.566352:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2bec7fc00/0xb5d1f3b1a19027d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5dbc expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604090.566382:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2bec7fc00/0xb5d1f3b1a19027d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5dbc expref: 6 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604090.566393:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2bec7fc00/0xb5d1f3b1a19027d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5dbc expref: 6 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604090.566417:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7fc00, rc 0) 00000100:00100000:1.0:1787604090.566956:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+6:13750:x1874438345826432:12345-192.168.202.21@tcp:101:mount.lustre.0 Request processed in 654us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604090.566964:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 76 00000100:00100000:2.0:1787604090.571105:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604090.571198:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345826560 00000100:00100000:3.0:1787604090.571209:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345826560 00000100:00100000:3.0:1787604090.571265:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 77 00000100:00100000:3.0:1787604090.571276:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+6:13750:x1874438345826560:12345-192.168.202.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787604090.572155:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+6:13750:x1874438345826560:12345-192.168.202.21@tcp:501:mount.lustre.0 Request processed in 875us (1131us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787604090.572167:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 77 00000100:00100000:0.0:1787604090.577414:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604090.577522:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345826688 00000100:00100000:1.0:1787604090.577533:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345826688 00000100:00100000:1.0:1787604090.577579:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 78 00000100:00100000:1.0:1787604090.577590:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+6:13750:x1874438345826688:12345-192.168.202.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787604090.577606:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604090.577639:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2bec7fa00/0xb5d1f3b1a19027da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5dc3 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604090.577671:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2bec7fa00/0xb5d1f3b1a19027da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5dc3 expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604090.577683:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2bec7fa00/0xb5d1f3b1a19027da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5dc3 expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604090.577706:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7fa00, rc 0) 00000100:00100000:1.0:1787604090.577832:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+7:13750:x1874438345826688:12345-192.168.202.21@tcp:101:mount.lustre.0 Request processed in 243us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604090.577867:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 78 00000100:00100000:2.0:1787604090.585513:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604090.586196:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345826816 00000100:00100000:0.0:1787604090.586208:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345826816 00000100:00100000:0.0:1787604090.586272:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 79 00000100:00100000:0.0:1787604090.586284:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+7:13750:x1874438345826816:12345-192.168.202.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787604090.586601:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+8:13750:x1874438345826816:12345-192.168.202.21@tcp:501:mount.lustre.0 Request processed in 318us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604090.586609:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 79 00000100:00100000:2.0:1787604090.593888:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604090.593990:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345826944 00000100:00100000:1.0:1787604090.594000:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345826944 00000100:00100000:1.0:1787604090.594071:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 80 00000100:00100000:1.0:1787604090.594082:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+8:13750:x1874438345826944:12345-192.168.202.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787604090.594396:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+8:13750:x1874438345826944:12345-192.168.202.21@tcp:503:mount.lustre.0 Request processed in 314us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604090.594405:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 80 00000100:00100000:2.0:1787604090.610397:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604090.610592:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345827072 00000100:00100000:0.0:1787604090.610602:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345827072 00000100:00100000:0.0:1787604090.610656:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 81 00000100:00100000:0.0:1787604090.610666:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+8:13769:x1874438345827072:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787604090.611022:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+8:13769:x1874438345827072:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 356us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604090.611193:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 81 00000100:00100000:2.0:1787604090.625150:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604090.625350:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345827200 00000100:00100000:3.0:1787604090.625362:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345827200 00000100:00100000:3.0:1787604090.625432:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 82 00000100:00100000:3.0:1787604090.625442:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2984c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+8:13769:x1874438345827200:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787604090.625732:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2984c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+8:13769:x1874438345827200:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 290us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604090.625741:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 82 00000100:00100000:2.0:1787604090.635357:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604090.635587:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345827328 00000100:00100000:1.0:1787604090.635598:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345827328 00000100:00100000:1.0:1787604090.635651:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 83 00000100:00100000:1.0:1787604090.635663:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+8:13750:x1874438345827328:12345-192.168.202.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787604090.635679:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604090.635714:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2bec7ee00/0xb5d1f3b1a19027e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ded expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604090.635763:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2bec7ee00/0xb5d1f3b1a19027e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ded expref: 9 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604090.635775:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2bec7ee00/0xb5d1f3b1a19027e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ded expref: 9 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604090.635785:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7ee00, rc 0) 00000100:00100000:1.0:1787604090.635875:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+9:13750:x1874438345827328:12345-192.168.202.21@tcp:101:mount.lustre.0 Request processed in 213us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604090.635882:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 83 00000100:00100000:2.0:1787604090.639391:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604090.639545:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345827456 00000100:00100000:0.0:1787604090.639555:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345827456 00000100:00100000:0.0:1787604090.639620:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 84 00000100:00100000:0.0:1787604090.639632:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+9:13750:x1874438345827456:12345-192.168.202.21@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787604090.639659:0:14347:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787604090.639680:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787604090.639684:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787604090.639688:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787604090.639691:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787604090.641987:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+9:13750:x1874438345827456:12345-192.168.202.21@tcp:256:mount.lustre.0 Request processed in 2340us (2588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604090.642005:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 84 00000100:00100000:2.0:1787604090.647126:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604090.647534:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345827584 00000100:00100000:1.0:1787604090.647548:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345827584 00000100:00100000:1.0:1787604090.647610:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 85 00000100:00100000:1.0:1787604090.647621:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+9:13750:x1874438345827584:12345-192.168.202.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787604090.647645:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604090.647666:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a19027e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5df4 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604090.647709:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a19027e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5df4 expref: 10 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604090.647726:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a19027e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5df4 expref: 10 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604090.647737:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7ec00, rc 0) 00000100:00100000:1.0:1787604090.647891:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+10:13750:x1874438345827584:12345-192.168.202.21@tcp:101:mount.lustre.0 Request processed in 270us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604090.647921:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 85 00000100:00100000:2.0:1787604090.649299:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604090.649375:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345827712 00000100:00100000:0.0:1787604090.649386:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345827712 00000100:00100000:0.0:1787604090.649443:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 86 00000100:00100000:0.0:1787604090.649455:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+10:13750:x1874438345827712:12345-192.168.202.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787604090.649875:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+10:13750:x1874438345827712:12345-192.168.202.21@tcp:501:mount.lustre.0 Request processed in 381us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604090.649884:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 86 00000100:00100000:2.0:1787604090.653203:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604090.653317:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345827840 00000100:00100000:1.0:1787604090.653331:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345827840 00000100:00100000:1.0:1787604090.653409:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 87 00000100:00100000:1.0:1787604090.653424:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+10:13750:x1874438345827840:12345-192.168.202.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787604090.654153:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+10:13750:x1874438345827840:12345-192.168.202.21@tcp:503:mount.lustre.0 Request processed in 727us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604090.654163:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 87 00000100:00100000:2.0:1787604090.658012:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604090.658418:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345827968 00000100:00100000:0.0:1787604090.658430:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345827968 00000100:00100000:0.0:1787604090.658498:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 88 00000100:00100000:0.0:1787604090.658512:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+10:13774:x1874438345827968:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787604090.658922:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+10:13774:x1874438345827968:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 411us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604090.658932:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 88 00000100:00100000:2.0:1787604090.661007:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604090.661084:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345828096 00000100:00100000:1.0:1787604090.661096:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345828096 00000100:00100000:1.0:1787604090.661157:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 89 00000100:00100000:1.0:1787604090.661168:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+10:13774:x1874438345828096:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787604090.661455:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+10:13774:x1874438345828096:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 288us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604090.661464:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 89 00000100:00100000:2.0:1787604090.669545:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604090.669934:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345828224 00000100:00100000:3.0:1787604090.669948:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345828224 00000100:00100000:3.0:1787604090.670017:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:3.0:1787604090.670030:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2362:x1874438345828224:12345-192.168.202.21@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787604090.670076:0:14352:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 75376845-43d4-452b-be27-6d742e8a3513@192.168.202.21@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:3.0:1787604090.670355:0:14352:0:(genops.c:1385:class_connect()) connect: client 75376845-43d4-452b-be27-6d742e8a3513, cookie 0xb5d1f3b1a19027ef 00000004:00100000:3.0:1787604090.670399:0:14352:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:3.0:1787604090.670407:0:14352:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787604090.699728:0:14352:0:(import.c:65:import_set_state_nolock()) ffff9ed182263800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787604090.699932:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+6:2362:x1874438345828224:12345-192.168.202.21@tcp:38:mount.lustre.0 Request processed in 29900us (30409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604090.699965:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:2.0:1787604090.703329:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604090.703390:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604090.704294:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345828480 00000100:00100000:3.0:1787604090.704310:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345828480 00000100:00100000:3.0:1787604090.704435:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345828352 00000100:00100000:3.0:1787604090.704439:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345828352 00000100:00080000:1.0:1787604090.704500:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787604090.704525:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:0.0:1787604090.704539:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+7:13750:x1874438345828480:12345-192.168.202.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787604090.704599:0:14353:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787604090.704719:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+7:13750:x1874438345828480:12345-192.168.202.21@tcp:41:mount.lustre.0 Request processed in 184us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604090.704728:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:0.0:1787604090.704759:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:0.0:1787604090.704767:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2c1ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+6:0:x1874438345828352:12345-192.168.202.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787604090.704779:0:14353:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787604090.704801:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2c1ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+6:0:x1874438345828352:12345-192.168.202.21@tcp:41:mount.lustre.0 Request processed in 35us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604090.704807:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:0.0:1787604090.706878:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604090.706962:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345828608 00000100:00100000:3.0:1787604090.706973:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345828608 00000100:00100000:3.0:1787604090.707083:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:3.0:1787604090.707104:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+6:13750:x1874438345828608:12345-192.168.202.21@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787604090.707206:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+6:13750:x1874438345828608:12345-192.168.202.21@tcp:40:mount.lustre.0 Request processed in 105us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604090.707213:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:1.0:1787604090.709108:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604090.709141:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604090.709181:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604090.709233:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345828736 00000100:00100000:2.0:1787604090.709264:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345828736 00000100:00100000:2.0:1787604090.709313:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345828864 00000100:00100000:2.0:1787604090.709317:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345828864 00000100:00100000:2.0:1787604090.709332:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:2.0:1787604090.709342:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874438345828736:12345-192.168.202.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787604090.709381:0:15036:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 75376845-43d4-452b-be27-6d742e8a3513@192.168.202.21@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:2.0:1787604090.709422:0:15036:0:(genops.c:1385:class_connect()) connect: client 75376845-43d4-452b-be27-6d742e8a3513, cookie 0xb5d1f3b1a19027f6 00002000:00100000:2.0:1787604090.709439:0:15036:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 75376845-43d4-452b-be27-6d742e8a3513/ffff9ed18126f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787604090.709472:0:15036:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00000100:00100000:0.0:1787604090.709903:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345828992 00000100:00100000:0.0:1787604090.709917:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345828992 00000100:00100000:0.0:1787604090.709958:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:0.0:1787604090.709967:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75376845-43d4-452b-be27-6d742e8a3513+6:13750:x1874438345828992:12345-192.168.202.21@tcp:33:mount.lustre.0 00000100:00100000:0.0:1787604090.710116:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604090.710246:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345829120 00000100:00100000:1.0:1787604090.710251:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345829120 00000100:00100000:1.0:1787604090.710288:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 90 00000100:00100000:1.0:1787604090.710296:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+10:2364:x1874438345829120:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604090.710365:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+10:2364:x1874438345829120:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 70us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604090.710383:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 90 00002000:00080000:2.0:1787604090.710419:0:15036:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787604090.710454:0:15036:0:(import.c:65:import_set_state_nolock()) ffff9ed18126c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787604090.710486:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75376845-43d4-452b-be27-6d742e8a3513+6:2362:x1874438345828736:12345-192.168.202.21@tcp:8:mount.lustre.0 Request processed in 1145us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604090.710494:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:2.0:1787604090.710510:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:2.0:1787604090.710515:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874438345828864:12345-192.168.202.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787604090.710534:0:15036:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 75376845-43d4-452b-be27-6d742e8a3513@192.168.202.21@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:2.0:1787604090.710557:0:15036:0:(genops.c:1385:class_connect()) connect: client 75376845-43d4-452b-be27-6d742e8a3513, cookie 0xb5d1f3b1a19027fd 00002000:00100000:2.0:1787604090.710564:0:15036:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 75376845-43d4-452b-be27-6d742e8a3513/ffff9ed18126a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787604090.710582:0:15036:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787604090.710733:0:15036:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787604090.710965:0:15036:0:(import.c:65:import_set_state_nolock()) ffff9ed18126e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787604090.710993:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75376845-43d4-452b-be27-6d742e8a3513+6:2362:x1874438345828864:12345-192.168.202.21@tcp:8:mount.lustre.0 Request processed in 476us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604090.710999:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 9 00000004:00080000:0.0:1787604090.713512:0:14355:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3466us 00000004:00200000:3.0:1787604090.725077:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787604090.725295:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75376845-43d4-452b-be27-6d742e8a3513+6:13750:x1874438345828992:12345-192.168.202.21@tcp:33:mount.lustre.0 Request processed in 15320us (16103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604090.725314:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:1.0:1787604090.870217:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604090.870505:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345829248 00000100:00100000:0.0:1787604090.870517:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345829248 00000100:00100000:0.0:1787604090.870661:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:0.0:1787604090.870672:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+6:13795:x1874438345829248:12345-192.168.202.21@tcp:101:mkdir.0 00010000:00010000:0.0:1787604090.870706:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604090.870747:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595a00/0xb5d1f3b1a1902804 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5e1e expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604090.870872:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190280b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604090.870888:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190280b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604090.870907:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190280b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787604090.871138:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787604090.871142:0:14353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787604090.871229:0:14353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190280b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604090.871255:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298595a00/0xb5d1f3b1a1902804 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e1e expref: 8 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604090.872098:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190280b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e1e expref: 7 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604090.872110:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787604090.872113:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787604090.872118:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594e00, rc 0) 00000100:00100000:0.0:1787604090.872304:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+7:13795:x1874438345829248:12345-192.168.202.21@tcp:101:mkdir.0 Request processed in 1631us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604090.872313:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 8 00010000:00010000:0.0:1787604091.350982:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604091.351279:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355256960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787604091.351392:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604091.351870:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355256960 00000100:00100000:1.0:1787604091.351881:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355256960 00000100:00100000:1.0:1787604091.351967:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787604091.351979:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355256960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787604091.352009:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604091.352068:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355256960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604091.352077:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787604091.352219:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787604091.352275:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355256960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787604092.377010:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604092.678817:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604092.679159:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345829376 00000100:00100000:3.0:1787604092.679174:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345829376 00000100:00100000:3.0:1787604092.679272:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:3.0:1787604092.679286:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+7:13847:x1874438345829376:12345-192.168.202.21@tcp:41:lfs.0 00000004:00000024:3.0:1787604092.679350:0:14354:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787604092.679566:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+7:13847:x1874438345829376:12345-192.168.202.21@tcp:41:lfs.0 Request processed in 281us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604092.679576:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00080000:0.0:1787604092.679658:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787604092.683409:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604092.683530:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345829504 00000100:00100000:3.0:1787604092.683544:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345829504 00000100:00100000:3.0:1787604092.683658:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:3.0:1787604092.683671:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75376845-43d4-452b-be27-6d742e8a3513+6:13847:x1874438345829504:12345-192.168.202.21@tcp:13:lfs.0 00002000:00000024:3.0:1787604092.683736:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604092.683895:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75376845-43d4-452b-be27-6d742e8a3513+6:13847:x1874438345829504:12345-192.168.202.21@tcp:13:lfs.0 Request processed in 226us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604092.683904:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00080000:0.0:1787604092.684000:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787604092.685906:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604092.686096:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345829632 00000100:00100000:3.0:1787604092.686108:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345829632 00000100:00100000:3.0:1787604092.686246:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:3.0:1787604092.686257:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75376845-43d4-452b-be27-6d742e8a3513+6:13847:x1874438345829632:12345-192.168.202.21@tcp:13:lfs.0 00002000:00000024:3.0:1787604092.686297:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604092.686390:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75376845-43d4-452b-be27-6d742e8a3513+6:13847:x1874438345829632:12345-192.168.202.21@tcp:13:lfs.0 Request processed in 136us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604092.686396:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00080000:0.0:1787604092.687946:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787604092.876788:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604092.877519:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345829760 00000100:00100000:0.0:1787604092.877533:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345829760 00000100:00100000:0.0:1787604092.877610:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 91 00000100:00100000:0.0:1787604092.877623:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+10:13878:x1874438345829760:12345-192.168.202.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787604092.877644:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604092.879231:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298595a00/0xb5d1f3b1a1902812 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5e25 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604092.879894:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298595a00/0xb5d1f3b1a1902812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e25 expref: 11 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604092.879913:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298595a00/0xb5d1f3b1a1902812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e25 expref: 11 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604092.879925:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595a00, rc 0) 00000100:00100000:0.0:1787604092.880112:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+11:13878:x1874438345829760:12345-192.168.202.21@tcp:101:mount.lustre.0 Request processed in 2488us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604092.880122:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 91 00000100:00100000:0.0:1787604092.887143:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787604092.887174:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b9df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355257088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787604092.887266:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604092.887503:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355257344:0@lo:400:kworker.0 00000100:00100000:3.0:1787604092.887540:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604092.887568:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787604092.887572:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e30912c-ffd9-4190-a569-23df3a025820:3282:1874438355257216:0@lo:400:kworker.0 00000100:00100000:3.0:1787604092.887606:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604092.887624:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355257728:0@lo:400:kworker.0 00000100:00100000:3.0:1787604092.887767:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604092.887797:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355257472:0@lo:400:kworker.0 00000100:00100000:3.0:1787604092.887822:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604092.887861:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787604092.887866:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355257600:0@lo:400:kworker.0 00000100:00100000:3.0:1787604092.887907:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604092.887936:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355257728 00000100:00100000:3.0:1787604092.887946:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355257728 00000100:00100000:3.0:1787604092.888000:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355257472 00000100:00100000:3.0:1787604092.888003:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355257472 00000100:00100000:3.0:1787604092.888018:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355257600 00000100:00100000:3.0:1787604092.888021:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355257600 00000100:00100000:3.0:1787604092.888040:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787604092.888050:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355257728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604092.888112:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874438355257728:12345-0@lo:400:kworker.0 Request processed in 63us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604092.888120:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787604092.888144:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787604092.888150:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355257472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604092.888181:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874438355257472:12345-0@lo:400:kworker.0 Request processed in 32us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604092.888188:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787604092.888198:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787604092.888204:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355257600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604092.888226:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355257600:12345-0@lo:400:kworker.0 Request processed in 22us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604092.888231:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787604092.888247:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787604092.888279:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3282:1874438355257728:0@lo:400:kworker.0 00000100:00100000:3.0:1787604092.888308:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355257600:0@lo:400:kworker.0 00000100:00100000:3.0:1787604092.888317:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874438355257472:0@lo:400:kworker.0 00000100:00100000:3.0:1787604092.888344:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355257088 00000100:00100000:3.0:1787604092.888348:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355257088 00000100:00100000:3.0:1787604092.888381:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787604092.888387:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874438355257088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787604092.888405:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604092.888441:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874438355257088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604092.888448:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787604092.888460:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787604092.888480:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b9df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355257088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787604092.888581:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355257344 00000100:00100000:1.0:1787604092.888586:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355257344 00000100:00100000:1.0:1787604092.888623:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787604092.888631:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355257344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604092.888718:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355257344:12345-0@lo:400:kworker.0 Request processed in 88us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604092.888725:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787604092.888745:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355257216 00000100:00100000:1.0:1787604092.888749:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355257216 00000100:00100000:1.0:1787604092.888770:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787604092.888777:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+19:3282:x1874438355257216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604092.888808:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+19:3282:x1874438355257216:12345-0@lo:400:kworker.0 Request processed in 31us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604092.888814:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787604092.888896:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e30912c-ffd9-4190-a569-23df3a025820:3282:1874438355257216:0@lo:400:kworker.0 00000100:00100000:1.0:1787604092.888908:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355257344:0@lo:400:kworker.0 00000100:00100000:2.0:1787604092.889880:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604092.889913:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345829888 00000100:00100000:2.0:1787604092.889919:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345829888 00000100:00100000:2.0:1787604092.889955:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 93 00000100:00100000:2.0:1787604092.889964:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+11:13878:x1874438345829888:12345-192.168.202.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787604092.890313:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+11:13878:x1874438345829888:12345-192.168.202.21@tcp:501:mount.lustre.0 Request processed in 348us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604092.890324:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 93 00000100:00100000:3.0:1787604092.920320:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604092.921034:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345830016 00000100:00100000:3.0:1787604092.921046:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345830016 00000100:00100000:3.0:1787604092.921089:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 94 00000100:00100000:3.0:1787604092.921097:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+11:13878:x1874438345830016:12345-192.168.202.21@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787604092.921306:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+11:13878:x1874438345830016:12345-192.168.202.21@tcp:503:mount.lustre.0 Request processed in 208us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604092.921315:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 94 00000100:00100000:3.0:1787604092.931883:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604092.932056:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345830144 00000100:00100000:2.0:1787604092.932073:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345830144 00000100:00100000:2.0:1787604092.932145:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 95 00000100:00100000:2.0:1787604092.932158:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+11:13886:x1874438345830144:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787604092.934801:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+11:13886:x1874438345830144:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 2627us (3077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604092.934823:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 95 00000100:00100000:2.0:1787604092.958592:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604092.966422:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345830272 00000100:00100000:3.0:1787604092.966443:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345830272 00000100:00100000:3.0:1787604092.966516:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 96 00000100:00100000:3.0:1787604092.966528:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b6f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+11:13886:x1874438345830272:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787604092.967336:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b6f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+11:13886:x1874438345830272:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 804us (8820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604092.967348:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 96 00000100:00100000:3.0:1787604092.975211:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604092.975403:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345830400 00000100:00100000:2.0:1787604092.975414:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345830400 00000100:00100000:2.0:1787604092.975470:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 97 00000100:00100000:2.0:1787604092.975481:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+11:13878:x1874438345830400:12345-192.168.202.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787604092.975498:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604092.975516:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b4962000/0xb5d1f3b1a1902819 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5e4f expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604092.975542:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4962000/0xb5d1f3b1a1902819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e4f expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604092.975552:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b4962000/0xb5d1f3b1a1902819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e4f expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604092.975577:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962000, rc 0) 00000100:00100000:2.0:1787604092.975628:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+12:13878:x1874438345830400:12345-192.168.202.21@tcp:101:mount.lustre.0 Request processed in 149us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604092.975636:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 97 00000100:00100000:2.0:1787604092.982725:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604092.983043:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345830528 00000100:00100000:3.0:1787604092.983053:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345830528 00000100:00100000:3.0:1787604092.983114:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 98 00000100:00100000:3.0:1787604092.983125:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+12:13878:x1874438345830528:12345-192.168.202.21@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787604092.983149:0:14346:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787604092.983166:0:14346:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787604092.983169:0:14346:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787604092.983173:0:14346:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787604092.983175:0:14346:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787604092.986218:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+12:13878:x1874438345830528:12345-192.168.202.21@tcp:256:mount.lustre.0 Request processed in 3084us (3503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604092.986233:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 98 00000100:00100000:0.0:1787604092.989233:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604092.989373:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345830656 00000100:00100000:2.0:1787604092.989383:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345830656 00000100:00100000:2.0:1787604092.989440:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 99 00000100:00100000:2.0:1787604092.989451:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+12:13878:x1874438345830656:12345-192.168.202.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787604092.989467:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604092.989484:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a1902820 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5e56 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604092.989512:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a1902820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e56 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604092.989523:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a1902820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e56 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604092.989533:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963c00, rc 0) 00000100:00100000:2.0:1787604092.989592:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13878:x1874438345830656:12345-192.168.202.21@tcp:101:mount.lustre.0 Request processed in 143us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604092.989599:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 99 00000100:00100000:3.0:1787604092.991258:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604092.991340:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345830784 00000100:00100000:0.0:1787604092.991347:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345830784 00000100:00100000:0.0:1787604092.991400:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 100 00000100:00100000:0.0:1787604092.991420:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13878:x1874438345830784:12345-192.168.202.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787604092.991698:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13878:x1874438345830784:12345-192.168.202.21@tcp:501:mount.lustre.0 Request processed in 288us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604092.991707:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 100 00000100:00100000:0.0:1787604092.993499:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604092.993612:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345830912 00000100:00100000:3.0:1787604092.993622:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345830912 00000100:00100000:3.0:1787604092.993670:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 101 00000100:00100000:3.0:1787604092.993697:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13878:x1874438345830912:12345-192.168.202.21@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787604092.993920:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13878:x1874438345830912:12345-192.168.202.21@tcp:503:mount.lustre.0 Request processed in 224us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604092.993928:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 101 00000001:00100000:0.0:1787604092.995833:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75376845-43d4-452b-be27-6d742e8a3513 00000001:00080000:0.0:1787604092.995888:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787604092.995935:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787604093.003304:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604093.003374:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345831040 00000100:00100000:3.0:1787604093.003384:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345831040 00000100:00100000:3.0:1787604093.003454:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 102 00000100:00100000:3.0:1787604093.003462:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13892:x1874438345831040:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787604093.003708:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13892:x1874438345831040:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 246us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604093.003717:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 102 00000100:00100000:1.0:1787604093.008582:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604093.012217:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345831168 00000100:00100000:0.0:1787604093.012230:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345831168 00000100:00100000:0.0:1787604093.012303:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 103 00000100:00100000:0.0:1787604093.012315:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13892:x1874438345831168:12345-192.168.202.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787604093.012695:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13892:x1874438345831168:12345-192.168.202.21@tcp:502:llog_process_th.0 Request processed in 381us (4119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604093.012704:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 103 00000100:00100000:0.0:1787604093.015115:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604093.015197:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345831296 00000100:00100000:3.0:1787604093.015207:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345831296 00000100:00100000:3.0:1787604093.015256:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:3.0:1787604093.015264:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2362:x1874438345831296:12345-192.168.202.21@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787604093.015290:0:14354:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ee6601d0-b3cd-4fa5-8064-db2f3416d82f@192.168.202.21@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:3.0:1787604093.015330:0:14354:0:(genops.c:1385:class_connect()) connect: client ee6601d0-b3cd-4fa5-8064-db2f3416d82f, cookie 0xb5d1f3b1a1902827 00000004:00100000:3.0:1787604093.015357:0:14354:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1787604093.015483:0:14354:0:(import.c:65:import_set_state_nolock()) ffff9ed2bf69a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787604093.015559:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:2362:x1874438345831296:12345-192.168.202.21@tcp:38:mount.lustre.0 Request processed in 294us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604093.015566:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:2.0:1787604093.024160:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604093.024280:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604093.024566:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345831424 00000100:00100000:0.0:1787604093.024578:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345831424 00000100:00100000:0.0:1787604093.024710:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345831552 00000100:00100000:0.0:1787604093.024714:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345831552 00000100:00100000:0.0:1787604093.024732:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:0.0:1787604093.024741:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+7:0:x1874438345831424:12345-192.168.202.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787604093.024782:0:14352:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787604093.024876:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+7:0:x1874438345831424:12345-192.168.202.21@tcp:41:mount.lustre.0 Request processed in 135us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604093.024884:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:0.0:1787604093.024903:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:0.0:1787604093.024911:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:13878:x1874438345831552:12345-192.168.202.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787604093.024921:0:14352:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787604093.024945:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:13878:x1874438345831552:12345-192.168.202.21@tcp:41:mount.lustre.0 Request processed in 36us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604093.024952:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00080000:1.0:1787604093.025541:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787604093.028718:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604093.028820:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345831680 00000100:00100000:0.0:1787604093.028876:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345831680 00000100:00100000:0.0:1787604093.028941:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:0.0:1787604093.028952:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:13878:x1874438345831680:12345-192.168.202.21@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787604093.029024:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:13878:x1874438345831680:12345-192.168.202.21@tcp:40:mount.lustre.0 Request processed in 75us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604093.029029:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:0.0:1787604093.034228:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604093.034265:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604093.034347:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604093.034647:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345832064 00000100:00100000:1.0:1787604093.034655:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345832064 00000100:00100000:1.0:1787604093.034721:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1 00000100:00100000:1.0:1787604093.034733:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:13878:x1874438345832064:12345-192.168.202.21@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787604093.034994:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787604093.035102:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:13878:x1874438345832064:12345-192.168.202.21@tcp:33:mount.lustre.0 Request processed in 372us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604093.035108:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1 00000100:00100000:3.0:1787604093.036251:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345831808 00000100:00100000:3.0:1787604093.036261:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345831808 00000100:00100000:3.0:1787604093.036299:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345831936 00000100:00100000:3.0:1787604093.036303:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345831936 00000100:00100000:3.0:1787604093.036317:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:3.0:1787604093.036329:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1874438345831808:12345-192.168.202.21@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787604093.036358:0:15033:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ee6601d0-b3cd-4fa5-8064-db2f3416d82f@192.168.202.21@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:3.0:1787604093.036383:0:15033:0:(genops.c:1385:class_connect()) connect: client ee6601d0-b3cd-4fa5-8064-db2f3416d82f, cookie 0xb5d1f3b1a190282e 00002000:00100000:3.0:1787604093.036577:0:15033:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ee6601d0-b3cd-4fa5-8064-db2f3416d82f/ffff9ed2bf698000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787604093.036599:0:15033:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787604093.036706:0:15033:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787604093.036744:0:15033:0:(import.c:65:import_set_state_nolock()) ffff9ed2bf69c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787604093.036807:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:2362:x1874438345831808:12345-192.168.202.21@tcp:8:mount.lustre.0 Request processed in 481us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604093.036814:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:3.0:1787604093.036900:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:3.0:1787604093.036905:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1874438345831936:12345-192.168.202.21@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787604093.036921:0:15033:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ee6601d0-b3cd-4fa5-8064-db2f3416d82f@192.168.202.21@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:3.0:1787604093.036937:0:15033:0:(genops.c:1385:class_connect()) connect: client ee6601d0-b3cd-4fa5-8064-db2f3416d82f, cookie 0xb5d1f3b1a1902835 00002000:00100000:3.0:1787604093.036942:0:15033:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ee6601d0-b3cd-4fa5-8064-db2f3416d82f/ffff9ed2bf69f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787604093.036948:0:15033:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787604093.037081:0:15033:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787604093.037093:0:15033:0:(import.c:65:import_set_state_nolock()) ffff9ed2bf698800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787604093.037110:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:2362:x1874438345831936:12345-192.168.202.21@tcp:8:mount.lustre.0 Request processed in 205us (2764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604093.037114:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:0.0:1787604093.187067:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604093.187209:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345832192 00000100:00100000:3.0:1787604093.187220:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345832192 00000100:00100000:3.0:1787604093.187288:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00100000:3.0:1787604093.187299:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:13913:x1874438345832192:12345-192.168.202.21@tcp:101:mkdir.0 00010000:00010000:3.0:1787604093.187320:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604093.187346:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a190283c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5e80 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604093.187430:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217c400/0xb5d1f3b1a1902843 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604093.187444:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217c400/0xb5d1f3b1a1902843 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604093.187459:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217c400/0xb5d1f3b1a1902843 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604093.187646:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787604093.187650:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787604093.187739:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217c400/0xb5d1f3b1a1902843 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604093.187765:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a190283c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e80 expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604093.188180:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217c400/0xb5d1f3b1a1902843 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e80 expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604093.188190:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:3.0:1787604093.188193:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787604093.188197:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217c400, rc 0) 00000100:00100000:3.0:1787604093.188272:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+7:13913:x1874438345832192:12345-192.168.202.21@tcp:101:mkdir.0 Request processed in 974us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604093.188279:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 14 00010000:00010000:0.0:1787604093.399699:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604094.430485:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787604095.037217:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 75376845-43d4-452b-be27-6d742e8a3513 00000001:00100000:1.0:1787604095.037246:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ee6601d0-b3cd-4fa5-8064-db2f3416d82f 00010000:00010000:0.0:1787604095.447577:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787604095.964688:0:16315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1787604096.021812:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ee6601d0-b3cd-4fa5-8064-db2f3416d82f 00000001:00100000:1.0:1787604096.021833:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 75376845-43d4-452b-be27-6d742e8a3513 00000100:00100000:2.0:1787604096.474937:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787604096.474970:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4e0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355257856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787604096.475066:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604096.475219:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355257856 00000100:00100000:3.0:1787604096.475231:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355257856 00000100:00100000:3.0:1787604096.475338:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787604096.475351:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355257856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787604096.475399:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604096.475459:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355257856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604096.475468:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787604096.475529:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4e0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355257856:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787604096.477045:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787604096.479885:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604097.495940:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604098.008947:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355258112:0@lo:400:kworker.0 00000100:00100000:3.0:1787604098.008957:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e30912c-ffd9-4190-a569-23df3a025820:3283:1874438355257984:0@lo:400:kworker.0 00000100:00100000:2.0:1787604098.009159:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355258240:0@lo:400:kworker.0 00000100:00100000:0.0:1787604098.009250:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355258368:0@lo:400:kworker.0 00000100:00100000:1.0:1787604098.011130:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604098.011167:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604098.011214:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355258496:0@lo:400:kworker.0 00000100:00100000:3.0:1787604098.011255:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604098.011319:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355257984 00000100:00100000:3.0:1787604098.011326:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355257984 00000100:00100000:3.0:1787604098.011373:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787604098.011381:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+19:3283:x1874438355257984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604098.011434:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+19:3283:x1874438355257984:12345-0@lo:400:kworker.0 Request processed in 54us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604098.011442:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787604098.011478:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355258496 00000100:00100000:3.0:1787604098.011481:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355258496 00000100:00100000:3.0:1787604098.011508:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787604098.011512:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355258496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604098.011535:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874438355258496:12345-0@lo:400:kworker.0 Request processed in 23us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604098.011540:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787604098.011541:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355258624:0@lo:400:kworker.0 00000100:00080000:3.0:1787604098.011564:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787604098.011587:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604098.012443:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355258112 00000100:00100000:1.0:1787604098.012450:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355258112 00000100:00100000:1.0:1787604098.012579:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787604098.012588:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355258112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604098.012665:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355258112:12345-0@lo:400:kworker.0 Request processed in 79us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604098.012673:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787604098.012715:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355258112:0@lo:400:kworker.0 00000100:00100000:0.0:1787604098.012754:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787604098.012911:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787604098.013196:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604098.013306:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355258624 00000100:00100000:1.0:1787604098.013311:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355258624 00000100:00100000:1.0:1787604098.013344:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355258368 00000100:00100000:1.0:1787604098.013348:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355258368 00000100:00100000:1.0:1787604098.013374:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787604098.013382:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355258624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604098.013570:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787604098.013588:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787604098.013619:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787604098.013642:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787604098.013652:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355258368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604098.013711:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355258624:12345-0@lo:400:kworker.0 Request processed in 330us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604098.013718:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787604098.013919:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355258624:0@lo:400:kworker.0 00000100:00080000:1.0:1787604098.013963:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787604098.014103:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e30912c-ffd9-4190-a569-23df3a025820:3283:1874438355257984:0@lo:400:kworker.0 00000100:00100000:1.0:1787604098.014115:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355258240 00000100:00100000:1.0:1787604098.014122:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355258240 00000100:00100000:3.0:1787604098.014133:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3283:1874438355258496:0@lo:400:kworker.0 00000100:00100000:1.0:1787604098.014158:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787604098.014167:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355258240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604098.014279:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355258240:12345-0@lo:400:kworker.0 Request processed in 43us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604098.014287:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787604098.014304:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787604098.014582:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787604098.014599:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355258240:0@lo:400:kworker.0 00000100:00100000:2.0:1787604098.014611:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355258752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787604098.014659:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604098.014754:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355258752 00000100:00100000:1.0:1787604098.014760:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355258752 00000100:00100000:1.0:1787604098.014909:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787604098.014917:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355258752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787604098.014957:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604098.015010:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355258752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604098.015018:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787604098.015070:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355258752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787604098.020582:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874438355258368:12345-0@lo:400:kworker.0 Request processed in 6923us (7820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604098.020597:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787604098.020971:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874438355258368:0@lo:400:kworker.0 00000001:00100000:0.0:1787604098.068866:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee6601d0-b3cd-4fa5-8064-db2f3416d82f 00000100:00100000:1.0:1787604098.351283:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604098.351329:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604098.351354:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604098.351381:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604098.351401:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604098.351418:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604098.351441:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604098.351468:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345832704 00000100:00100000:1.0:1787604098.351478:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345832704 00000100:00100000:1.0:1787604098.351527:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345832960 00000100:00100000:1.0:1787604098.351530:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345832960 00000100:00100000:1.0:1787604098.351543:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345832576 00000100:00100000:1.0:1787604098.351546:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345832576 00000100:00100000:1.0:1787604098.351556:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345833088 00000100:00100000:1.0:1787604098.351558:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345833088 00000100:00100000:1.0:1787604098.351573:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:1.0:1787604098.351583:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75376845-43d4-452b-be27-6d742e8a3513+5:2365:x1874438345832704:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604098.351667:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75376845-43d4-452b-be27-6d742e8a3513+5:2365:x1874438345832704:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 84us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604098.351676:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:1.0:1787604098.351693:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:1.0:1787604098.351714:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2365:x1874438345832960:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604098.351753:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2365:x1874438345832960:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 53us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604098.351761:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:1.0:1787604098.351773:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:1.0:1787604098.351780:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75376845-43d4-452b-be27-6d742e8a3513+5:2365:x1874438345832576:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604098.351800:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75376845-43d4-452b-be27-6d742e8a3513+5:2365:x1874438345832576:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 21us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604098.351806:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:1.0:1787604098.351818:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:1.0:1787604098.351824:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2365:x1874438345833088:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604098.351863:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2365:x1874438345833088:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604098.351870:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:1.0:1787604098.351890:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345832320 00000100:00100000:1.0:1787604098.351893:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345832320 00000100:00100000:1.0:1787604098.351919:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 105 00000100:00100000:1.0:1787604098.351926:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:2365:x1874438345832320:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604098.351949:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:2365:x1874438345832320:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 24us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604098.351955:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 105 00000100:00100000:1.0:1787604098.351982:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345832448 00000100:00100000:1.0:1787604098.351985:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345832448 00000100:00100000:1.0:1787604098.352008:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345832832 00000100:00100000:1.0:1787604098.352010:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345832832 00000100:00100000:1.0:1787604098.352029:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:1.0:1787604098.352041:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+6:2365:x1874438345832448:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604098.352067:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+6:2365:x1874438345832448:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 27us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604098.352074:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:1.0:1787604098.352085:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00100000:1.0:1787604098.352091:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:2365:x1874438345832832:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604098.352109:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:2365:x1874438345832832:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 19us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604098.352115:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00080000:1.0:1787604098.352129:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787604098.352133:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787604098.352135:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787604098.519078:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787604098.782641:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787604099.543627:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787604100.108589:0:16466:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd239d9a70 20000000:00000080:3.0:1787604100.108605:0:16466:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ed2b64a0000 uarg=0000000000000000 20000000:01000000:3.0:1787604100.108653:0:16466:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787604100.108659:0:16466:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787604100.108663:0:16466:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787604100.110136:0:16467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787604100.110299:0:16466:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787604100.116281:0:16466:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787604100.116514:0:16466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.116534:0:16466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a1902541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190253a expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.116542:0:16466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a190258e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902587 expref: 18 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.116549:0:16466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b4962e00/0xb5d1f3b1a19026c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a19026c2 expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.116559:0:16466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a19027e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5df4 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.116567:0:16466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a1902820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e56 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.116591:0:16466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.116646:0:16466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a1902820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e56 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.116661:0:16466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a1902820 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e56 expref: 12 pid: 14347 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604100.116676:0:16466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16466:1874438355258880:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604100.116826:0:16466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a19027e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5df4 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.116860:0:16466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a19027e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5df4 expref: 12 pid: 14345 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604100.116870:0:16466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16466:1874438355259008:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604100.116903:0:16466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b4962e00/0xb5d1f3b1a19026c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a19026c2 expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.116911:0:16466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2b4962e00/0xb5d1f3b1a19026c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a19026c2 expref: 18 pid: 14346 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604100.116920:0:16466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16466:1874438355259136:0@lo:104: 00000100:00100000:2.0:1787604100.116957:0:16466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787604100.116995:0:16466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a190258e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a1902587 expref: 18 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.117014:0:16466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a190258e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a1902587 expref: 18 pid: 14345 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604100.117022:0:16466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16466:1874438355259264:0@lo:104: 00000100:00100000:2.0:1787604100.117046:0:16466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787604100.117081:0:16466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a1902541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb5d1f3b1a190253a expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.117089:0:16466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a1902541 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb5d1f3b1a190253a expref: 18 pid: 14347 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604100.117097:0:16466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16466:1874438355259392:0@lo:104: 00000100:00100000:2.0:1787604100.117121:0:16466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604100.117131:0:16466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed28706a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787604100.117218:0:14336:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787604100.117248:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355259136 00000100:00100000:3.0:1787604100.117254:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355259136 00000100:00100000:3.0:1787604100.117292:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355259264 00000100:00100000:3.0:1787604100.117296:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355259264 00000100:00100000:3.0:1787604100.117308:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355259392 00000100:00100000:3.0:1787604100.117311:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355259392 00000100:00100000:3.0:1787604100.117325:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787604100.117460:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e30912c-ffd9-4190-a569-23df3a025820+5:16466:x1874438355259136:12345-0@lo:104: 00010000:00010000:3.0:1787604100.117474:0:14336:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19026c9 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117530:0:14336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787604100.117537:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e30912c-ffd9-4190-a569-23df3a025820+5:16466:x1874438355259136:12345-0@lo:104: Request processed in 204us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604100.117544:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787604100.117563:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787604100.117569:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e30912c-ffd9-4190-a569-23df3a025820+4:16466:x1874438355259264:12345-0@lo:104: 00010000:00010000:3.0:1787604100.117584:0:14336:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a190258e expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117629:0:14336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787604100.117634:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e30912c-ffd9-4190-a569-23df3a025820+4:16466:x1874438355259264:12345-0@lo:104: Request processed in 66us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604100.117641:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787604100.117656:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787604100.117663:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf358c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e30912c-ffd9-4190-a569-23df3a025820+3:16466:x1874438355259392:12345-0@lo:104: 00010000:00010000:3.0:1787604100.117671:0:14336:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1902541 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117707:0:14336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787604100.117712:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf358c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e30912c-ffd9-4190-a569-23df3a025820+3:16466:x1874438355259392:12345-0@lo:104: Request processed in 50us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604100.117717:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787604100.117754:0:15692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787604100.117760:0:15692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a19026c9 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117767:0:15692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e800 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787604100.117771:0:15692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a19026c9 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117780:0:15692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a19026c9 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604100.117786:0:15692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a19026c9 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604100.117799:0:15692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787604100.117830:0:15692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19026c9 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117860:0:15692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787604100.117881:0:15692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19026c9 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117887:0:15692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7e800/0xb5d1f3b1a19026c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a19026c9 expref: -99 pid: 15754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117899:0:15692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787604100.117902:0:15692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a190258e expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117908:0:15692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed298594c00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787604100.117911:0:15692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a190258e expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117917:0:15692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a190258e expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604100.117923:0:15692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a190258e expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604100.117928:0:15692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787604100.117941:0:15692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190258e expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117946:0:15692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787604100.117966:0:15692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190258e expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117972:0:15692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed298594c00/0xb5d1f3b1a1902587 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a190258e expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117980:0:15692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604100.117983:0:15692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb5d1f3b1a1902541 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117989:0:15692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b5dade00 already unused, calling callback (ffffffffc1dfec20) 10000000:00010000:3.0:1787604100.117991:0:15692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb5d1f3b1a1902541 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.117997:0:15692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb5d1f3b1a1902541 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604100.118002:0:15692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb5d1f3b1a1902541 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604100.118006:0:15692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787604100.118018:0:15692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1902541 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.118023:0:15692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787604100.118027:0:15692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1902541 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.118032:0:15692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.121@tcp lock: ffff9ed2b5dade00/0xb5d1f3b1a190253a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb5d1f3b1a1902541 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.118053:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604100.118055:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604100.118057:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604100.118076:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e30912c-ffd9-4190-a569-23df3a025820:3282:1874438355259520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604100.118106:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604100.118139:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e30912c-ffd9-4190-a569-23df3a025820:3283:1874438355259648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604100.118161:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604100.118179:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787604100.118184:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e30912c-ffd9-4190-a569-23df3a025820:3283:1874438355259776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604100.118205:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604100.118227:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355259520 00000100:00100000:3.0:1787604100.118231:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355259520 00010000:00010000:3.0:1787604100.118249:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b4962e00/0xb5d1f3b1a19026c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19026c2 expref: 19 pid: 14346 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604100.118265:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355259648 00000100:00100000:3.0:1787604100.118268:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355259648 00010000:00010000:3.0:1787604100.118278:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a190258e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1902587 expref: 20 pid: 14345 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604100.118287:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355259776 00000100:00100000:3.0:1787604100.118289:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355259776 00010000:00010000:3.0:1787604100.118297:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a1902541 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190253a expref: 21 pid: 14347 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604100.118307:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787604100.118312:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e30912c-ffd9-4190-a569-23df3a025820+21:3282:x1874438355259520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787604100.118329:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604100.118512:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604100.118529:0:14338:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787604100.118536:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787604100.118648:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787604100.118656:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e30912c-ffd9-4190-a569-23df3a025820+21:3283:x1874438355259648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787604100.118664:0:14338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604100.118669:0:14338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a190258e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a1902587 expref: 21 pid: 14345 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604100.118679:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a190258e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a1902587 expref: 21 pid: 14345 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604100.118694:0:14338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604100.118726:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e30912c-ffd9-4190-a569-23df3a025820+21:3283:x1874438355259648:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604100.118733:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787604100.118750:0:14338:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787604100.118758:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787604100.118778:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287e58450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e30912c-ffd9-4190-a569-23df3a025820+20:3283:x1874438355259776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787604100.118787:0:14338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604100.118792:0:14338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a1902541 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a190253a expref: 20 pid: 14347 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604100.118800:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a1902541 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a190253a expref: 20 pid: 14347 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604100.118809:0:14338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604100.118833:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287e58450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e30912c-ffd9-4190-a569-23df3a025820+20:3283:x1874438355259776:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604100.118862:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787604100.119275:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b4962e00/0xb5d1f3b1a19026c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb5d1f3b1a19026c2 expref: 21 pid: 14346 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.119286:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b4962e00/0xb5d1f3b1a19026c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb5d1f3b1a19026c2 expref: 19 pid: 14346 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.119296:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787604100.119711:0:16466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b4962e00/0xb5d1f3b1a19026c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a19026c2 expref: 19 pid: 14346 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604100.119724:0:16466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16466:1874438355259136:0@lo:104: 00010000:00010000:2.0:1787604100.119736:0:16466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b4962c00/0xb5d1f3b1a190258e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a1902587 expref: 18 pid: 14345 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604100.119744:0:16466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16466:1874438355259264:0@lo:104: 00010000:00010000:2.0:1787604100.119751:0:16466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a1902541 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb5d1f3b1a190253a expref: 17 pid: 14347 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604100.119760:0:16466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16466:1874438355259392:0@lo:104: 00000100:00100000:3.0:1787604100.119802:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e30912c-ffd9-4190-a569-23df3a025820+16:3282:x1874438355259520:12345-0@lo:103:ldlm_bl.0 Request processed in 1489us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604100.119810:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787604100.119914:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e30912c-ffd9-4190-a569-23df3a025820:3283:1874438355259776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604100.119922:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e30912c-ffd9-4190-a569-23df3a025820:3283:1874438355259648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787604100.119998:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e30912c-ffd9-4190-a569-23df3a025820:3282:1874438355259520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787604100.121734:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604100.127315:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604100.127359:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604100.127603:0:16468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345833344 00000100:00100000:3.0:1787604100.127623:0:16468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345833344 00010000:00010000:3.0:1787604100.127661:0:16468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a19027e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5df4 expref: 13 pid: 14345 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604100.127699:0:16468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345833216 00000100:00100000:3.0:1787604100.127702:0:16468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345833216 00010000:00010000:3.0:1787604100.127714:0:16468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a1902820 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e56 expref: 14 pid: 14347 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604100.127732:0:16468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:3.0:1787604100.127741:0:16468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4e0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+14:2364:x1874438345833344:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787604100.127754:0:16468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604100.127760:0:16468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a19027e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5df4 expref: 14 pid: 14345 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.127783:0:16468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a19027e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5df4 expref: 14 pid: 14345 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.127803:0:16468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787604100.127881:0:16468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4e0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+14:2364:x1874438345833344:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 140us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604100.127889:0:16468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:3.0:1787604100.127909:0:16468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:3.0:1787604100.127916:0:16468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:2364:x1874438345833216:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787604100.127924:0:16468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604100.127928:0:16468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a1902820 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e56 expref: 13 pid: 14347 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.127937:0:16468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a1902820 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e56 expref: 13 pid: 14347 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.127949:0:16468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.127958:0:16468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.127971:0:16468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.127978:0:16468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.127985:0:16468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.127997:0:16468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.128002:0:16468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963e00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604100.128006:0:16468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.128014:0:16468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.128023:0:16468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.128034:0:16468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787604100.128055:0:16468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:2364:x1874438345833216:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 140us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604100.128062:0:16468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 8 00010000:00010000:2.0:1787604100.129782:0:16466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b4963c00/0xb5d1f3b1a1902820 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e56 expref: 12 pid: 14347 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604100.129814:0:16466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16466:1874438355258880:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604100.129830:0:16466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2bec7ec00/0xb5d1f3b1a19027e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5df4 expref: 11 pid: 14345 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604100.129995:0:16466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16466:1874438355259008:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604100.130031:0:16466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.130042:0:16466:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.130047:0:16466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604100.130053:0:16466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ed2b4963e00/0xb5d1f3b1a190284a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604100.567158:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604101.593665:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355259904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787604101.593747:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604101.594091:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355259904 00000100:00100000:1.0:1787604101.594100:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355259904 00000100:00100000:1.0:1787604101.594168:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787604101.594179:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355259904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787604101.594214:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604101.594264:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355259904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604101.594271:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787604101.594313:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355259904:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787604101.594388:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787604101.602519:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787604101.911017:0:14349:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787604101.911025:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed182409800 from 10 10000000:01000000:3.0:1787604101.911030:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787604101.911078:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a1902851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604101.911090:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a1902851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604101.911101:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a1902851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604101.911143:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787604101.911210:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604101.911349:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed282be26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604101.911583:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355260032 00000100:00100000:0.0:1787604101.911590:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355260032 00000100:00100000:0.0:1787604101.911810:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787604101.911819:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+16:14349:x1874438355260032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787604101.911834:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604101.911883:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a1902858 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a1902851 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604101.911907:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a1902858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902851 expref: 17 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604101.911917:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298594200/0xb5d1f3b1a1902858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a1902851 expref: 17 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604101.911926:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594200, rc 0) 00000100:00100000:0.0:1787604101.911976:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+17:14349:x1874438355260032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604101.911983:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787604101.912062:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787604101.912077:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a1902851 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902858 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604101.912085:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a1902851 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1902858 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604101.912144:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787604101.912173:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604101.912310:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed282be26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787604101.912756:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355260160 00000100:00100000:1.0:1787604101.912774:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355260160 00000100:00100000:1.0:1787604101.912800:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787604101.912806:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+17:14349:x1874438355260160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604101.913065:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+17:14349:x1874438355260160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604101.913072:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787604101.913162:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787604101.913196:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787604101.913231:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604101.913257:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed282be26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787604101.913302:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355260288 00000100:00100000:1.0:1787604101.913306:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355260288 00000100:00100000:1.0:1787604101.913330:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787604101.913336:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+17:14349:x1874438355260288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604101.913463:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+17:14349:x1874438355260288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604101.913470:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787604101.913606:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787604101.914577:0:16535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787604101.917934:0:14349:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787604101.917979:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787604101.917990:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a1902851 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902858 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604101.918004:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2c217da00/0xb5d1f3b1a1902851 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902858 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604101.918016:0:14349:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787604101.918020:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed287187000 from 10 10000000:01000000:1.0:1787604101.918023:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787604101.918064:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190285f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604101.918073:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190285f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604101.918105:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190285f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604101.918130:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787604101.918192:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604101.918288:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787604101.918721:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355260416 00000100:00100000:2.0:1787604101.918730:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355260416 00000100:00100000:0.0:1787604101.918799:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787604101.918810:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+17:14349:x1874438355260416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787604101.918827:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604101.918868:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a1902866 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190285f expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604101.918894:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a1902866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190285f expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604101.918917:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298594000/0xb5d1f3b1a1902866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190285f expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604101.918926:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594000, rc 0) 00000100:00100000:0.0:1787604101.918974:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+18:14349:x1874438355260416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604101.918980:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787604101.919063:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787604101.919078:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190285f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902866 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604101.919087:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190285f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1902866 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604101.919140:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604101.919167:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604101.919198:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604101.919247:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355260544 00000100:00100000:0.0:1787604101.919251:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355260544 00000100:00100000:0.0:1787604101.919290:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787604101.919297:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+18:14349:x1874438355260544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787604101.920026:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+18:14349:x1874438355260544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 727us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604101.920035:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787604101.920111:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604101.920144:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604101.920179:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604101.920207:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604101.920251:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355260672 00000100:00100000:0.0:1787604101.920255:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355260672 00000100:00100000:0.0:1787604101.920283:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787604101.920290:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+18:14349:x1874438355260672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787604101.920756:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+18:14349:x1874438355260672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 465us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604101.920763:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787604101.920956:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787604101.929398:0:16536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787604101.930131:0:14349:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787604101.930155:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787604101.930166:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190285f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902866 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604101.930190:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f200/0xb5d1f3b1a190285f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902866 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604101.930202:0:14349:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787604101.930204:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ed283965800 from 10 10000000:01000000:1.0:1787604101.930207:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787604101.930238:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f400/0xb5d1f3b1a190286d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604101.930245:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f400/0xb5d1f3b1a190286d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604101.930255:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f400/0xb5d1f3b1a190286d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604101.930371:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787604101.930435:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604101.930502:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604101.930544:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355260800 00000100:00100000:0.0:1787604101.930551:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355260800 00000100:00100000:0.0:1787604101.930690:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787604101.930700:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+18:14349:x1874438355260800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787604101.930719:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604101.930731:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298594800/0xb5d1f3b1a1902874 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5d1f3b1a190286d expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604101.930751:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298594800/0xb5d1f3b1a1902874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb5d1f3b1a190286d expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604101.930760:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298594800/0xb5d1f3b1a1902874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb5d1f3b1a190286d expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604101.930769:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594800, rc 0) 00000100:00100000:0.0:1787604101.930809:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+19:14349:x1874438355260800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604101.930815:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787604101.930892:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787604101.930905:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f400/0xb5d1f3b1a190286d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902874 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604101.930913:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f400/0xb5d1f3b1a190286d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb5d1f3b1a1902874 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604101.930959:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604101.930982:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604101.931150:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787604101.931237:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355260928 00000100:00100000:2.0:1787604101.931242:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355260928 00000100:00100000:2.0:1787604101.931281:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787604101.931289:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+19:14349:x1874438355260928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787604101.931555:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+19:14349:x1874438355260928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604101.931562:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787604101.931927:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355260928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604101.931960:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355261056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604101.931995:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604101.932020:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604101.932075:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355261056 00000100:00100000:0.0:1787604101.932079:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355261056 00000100:00100000:0.0:1787604101.932100:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787604101.932106:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+19:14349:x1874438355261056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787604101.932234:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e30912c-ffd9-4190-a569-23df3a025820+19:14349:x1874438355261056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604101.932240:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787604101.932316:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e30912c-ffd9-4190-a569-23df3a025820:14349:1874438355261056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787604101.933453:0:16537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787604101.933664:0:14349:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787604101.933685:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787604101.933694:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f400/0xb5d1f3b1a190286d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902874 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604101.933705:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.121@tcp lock: ffff9ed2bec7f400/0xb5d1f3b1a190286d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb5d1f3b1a1902874 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604102.057698:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604102.057895:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345833472 00000100:00100000:0.0:1787604102.057907:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345833472 00000100:00100000:0.0:1787604102.057957:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 115 00000100:00100000:0.0:1787604102.057969:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+11:13764:x1874438345833472:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787604102.057985:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604102.058004:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a190287b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5e87 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604102.058027:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a190287b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e87 expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604102.058035:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298594600/0xb5d1f3b1a190287b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e87 expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604102.058043:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298594600, rc 0) 00000100:00100000:0.0:1787604102.058096:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+12:13764:x1874438345833472:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 Request processed in 132us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604102.058101:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 115 00000100:00100000:3.0:1787604102.078543:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604102.078833:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345833600 00000100:00100000:0.0:1787604102.078901:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345833600 00000100:00100000:0.0:1787604102.079049:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 116 00000100:00100000:0.0:1787604102.079061:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+12:13764:x1874438345833600:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787604102.079355:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+12:13764:x1874438345833600:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 Request processed in 296us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604102.079363:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 116 00000100:00100000:1.0:1787604102.089508:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604102.089937:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345833728 00000100:00100000:0.0:1787604102.089947:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345833728 00000100:00100000:0.0:1787604102.089997:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 117 00000100:00100000:0.0:1787604102.090006:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+12:13764:x1874438345833728:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787604102.090196:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+12:13764:x1874438345833728:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 Request processed in 190us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604102.090204:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 117 00000100:00100000:1.0:1787604102.097381:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604102.097440:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345833856 00000100:00100000:0.0:1787604102.097449:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345833856 00000100:00100000:0.0:1787604102.097493:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 118 00000100:00100000:0.0:1787604102.097500:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+12:13764:x1874438345833856:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787604102.097515:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604102.097530:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ed298595e00/0xb5d1f3b1a1902882 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5e8e expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604102.097552:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ed298595e00/0xb5d1f3b1a1902882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e8e expref: 13 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604102.097560:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ed298595e00/0xb5d1f3b1a1902882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e8e expref: 13 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604102.097568:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed298595e00, rc 0) 00000100:00100000:0.0:1787604102.097633:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13764:x1874438345833856:12345-192.168.202.21@tcp:101:ll_cfg_requeue.0 Request processed in 132us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604102.097640:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 118 00000100:00100000:3.0:1787604102.109090:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604102.109569:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345833984 00000100:00100000:1.0:1787604102.109580:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345833984 00000100:00100000:1.0:1787604102.109649:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 119 00000100:00100000:1.0:1787604102.109661:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13764:x1874438345833984:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604102.109975:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13764:x1874438345833984:12345-192.168.202.21@tcp:501:ll_cfg_requeue.0 Request processed in 316us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604102.109984:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 119 00000100:00100000:3.0:1787604102.112112:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604102.115009:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345834112 00000100:00100000:0.0:1787604102.115022:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345834112 00000100:00100000:0.0:1787604102.115090:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 120 00000100:00100000:0.0:1787604102.115101:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13764:x1874438345834112:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787604102.115380:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:13764:x1874438345834112:12345-192.168.202.21@tcp:503:ll_cfg_requeue.0 Request processed in 280us (3275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604102.115410:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 120 00010000:00010000:0.0:1787604102.615243:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604103.130929:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355261312:0@lo:400:kworker.0 00000100:00100000:3.0:1787604103.131019:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604103.131090:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355261824:0@lo:400:kworker.0 00000100:00100000:3.0:1787604103.131115:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604103.131142:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787604103.131148:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355261440:0@lo:400:kworker.0 00000100:00100000:3.0:1787604103.131171:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604103.131207:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355261312 00000100:00100000:3.0:1787604103.131214:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355261312 00000100:00100000:3.0:1787604103.131281:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355261440 00000100:00100000:3.0:1787604103.131284:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355261440 00000100:00100000:3.0:1787604103.131302:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787604103.131322:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355261312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604103.131379:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355261312:12345-0@lo:400:kworker.0 Request processed in 68us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604103.131386:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787604103.131404:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787604103.131411:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355261440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604103.131966:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874438355261440:12345-0@lo:400:kworker.0 Request processed in 553us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604103.131973:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787604103.131996:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355261824 00000100:00100000:3.0:1787604103.132000:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355261824 00000100:00100000:3.0:1787604103.132029:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787604103.132037:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355261824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604103.132071:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874438355261824:12345-0@lo:400:kworker.0 Request processed in 35us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604103.132077:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787604103.132109:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787604103.132113:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787604103.132115:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604103.132147:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355261440:0@lo:400:kworker.0 00000100:00100000:3.0:1787604103.132160:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3283:1874438355261312:0@lo:400:kworker.0 00000100:00100000:3.0:1787604103.132182:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3283:1874438355261824:0@lo:400:kworker.0 00000100:00100000:2.0:1787604103.134370:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355261568:0@lo:400:kworker.0 00000100:00100000:2.0:1787604103.134450:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604103.134489:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787604103.134496:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e30912c-ffd9-4190-a569-23df3a025820:3281:1874438355261184:0@lo:400:kworker.0 00000100:00100000:2.0:1787604103.134525:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604103.134555:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355261696:0@lo:400:kworker.0 00000100:00100000:2.0:1787604103.136710:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604103.136763:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355261568 00000100:00100000:2.0:1787604103.136773:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355261568 00000100:00100000:2.0:1787604103.136823:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355261696 00000100:00100000:2.0:1787604103.136826:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355261696 00000100:00100000:2.0:1787604103.136874:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787604103.136883:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355261568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604103.136946:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355261568:12345-0@lo:400:kworker.0 Request processed in 63us (2497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604103.136954:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787604103.136972:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787604103.136979:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355261696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604103.137008:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874438355261696:12345-0@lo:400:kworker.0 Request processed in 30us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604103.137013:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787604103.137033:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355261184 00000100:00100000:2.0:1787604103.137037:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355261184 00000100:00100000:2.0:1787604103.137078:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787604103.137084:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+19:3281:x1874438355261184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604103.137117:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e30912c-ffd9-4190-a569-23df3a025820+19:3281:x1874438355261184:12345-0@lo:400:kworker.0 Request processed in 33us (2591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604103.137122:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1787604103.137160:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787604103.137520:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2b4bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355261952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787604103.137566:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604103.137622:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355261952 00000100:00100000:3.0:1787604103.137627:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355261952 00000100:00100000:3.0:1787604103.137655:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787604103.137663:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355261952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787604103.137693:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604103.137731:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355261952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604103.137737:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787604103.137782:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355261952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787604103.145725:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e30912c-ffd9-4190-a569-23df3a025820:3281:1874438355261184:0@lo:400:kworker.0 00000100:00100000:0.0:1787604103.145750:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3281:1874438355261696:0@lo:400:kworker.0 00000100:00100000:0.0:1787604103.145764:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2b4bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355261568:0@lo:400:kworker.0 00000100:00100000:1.0:1787604103.469489:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604103.469525:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604103.469550:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604103.469569:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604103.469598:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604103.469617:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604103.469640:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604103.469642:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345834240 00000100:00100000:0.0:1787604103.469652:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345834240 00000100:00100000:1.0:1787604103.469654:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345834496 00000100:00100000:1.0:1787604103.469656:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345834496 00000100:00100000:1.0:1787604103.469696:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345835008 00000100:00100000:1.0:1787604103.469699:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345835008 00000100:00100000:0.0:1787604103.469699:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 122 00000100:00100000:0.0:1787604103.469708:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:2363:x1874438345834240:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604103.469710:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345834624 00000100:00100000:1.0:1787604103.469712:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345834624 00000100:00100000:1.0:1787604103.469720:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345834880 00000100:00100000:1.0:1787604103.469722:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345834880 00000100:00100000:1.0:1787604103.469733:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:1.0:1787604103.469739:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75376845-43d4-452b-be27-6d742e8a3513+5:2363:x1874438345834496:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604103.469770:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75376845-43d4-452b-be27-6d742e8a3513+5:2363:x1874438345834496:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 31us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604103.469778:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:1.0:1787604103.469795:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:1.0:1787604103.469802:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2363:x1874438345835008:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787604103.469830:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:2363:x1874438345834240:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 122us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604103.469859:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 122 00000100:00100000:2.0:1787604103.469880:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345834752 00000100:00100000:2.0:1787604103.469885:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345834752 00000100:00080000:0.0:1787604103.469902:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787604103.469907:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787604103.469908:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787604103.469912:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345834368 00000100:00100000:2.0:1787604103.469915:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345834368 00000100:00100000:0.0:1787604103.469922:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 24 00000100:00100000:0.0:1787604103.469929:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:2363:x1874438345834752:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787604103.469936:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 25 00000100:00100000:2.0:1787604103.469942:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+6:2363:x1874438345834368:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787604103.469957:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:2363:x1874438345834752:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 29us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604103.469962:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+6:2363:x1874438345834368:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 21us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604103.469964:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 24 00000100:00080000:0.0:1787604103.469986:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787604103.470030:0:15033:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787604103.470034:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2363:x1874438345835008:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 232us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604103.470038:0:15033:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787604103.470040:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:1.0:1787604103.470053:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:1.0:1787604103.470060:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75376845-43d4-452b-be27-6d742e8a3513+5:2363:x1874438345834624:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604103.470081:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75376845-43d4-452b-be27-6d742e8a3513+5:2363:x1874438345834624:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 22us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604103.470099:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:1.0:1787604103.470110:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00100000:1.0:1787604103.470115:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2363:x1874438345834880:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604103.470137:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2363:x1874438345834880:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 22us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604103.470152:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00100000:2.0:1787604103.471472:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 25 00010000:00010000:3.0:1787604103.639036:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604104.393613:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604104.393730:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345835136 00000100:00100000:0.0:1787604104.393742:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345835136 00000100:00100000:0.0:1787604104.393808:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15 00000100:00100000:0.0:1787604104.393818:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+6:14423:x1874438345835136:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787604104.393872:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604104.393895:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a1902889 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5e95 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.393962:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a1902890 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.393977:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a1902890 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.393990:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a1902890 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.394019:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902897 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.394027:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.394033:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.394546:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4600/0xb5d1f3b1a190289e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.394566:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4600/0xb5d1f3b1a190289e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395005:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4600/0xb5d1f3b1a190289e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787604104.395096:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787604104.395101:0:14352:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787604104.395420:0:14352:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4600/0xb5d1f3b1a190289e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395432:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a1902890 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395439:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a1902890 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395446:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a1902890 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395451:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff5e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604104.395455:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a1902890 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395462:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a1902890 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395475:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787604104.395478:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604104.395484:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a1902890 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395502:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a1902890 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395514:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395743:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902897 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395752:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902897 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395756:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff4e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604104.395760:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902897 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395765:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902897 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395773:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ed28870b400) 00010000:00010000:0.0:1787604104.395776:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604104.395779:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902897 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395784:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902897 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395821:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a1902889 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e95 expref: 8 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395951:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4600/0xb5d1f3b1a190289e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e95 expref: 7 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.395959:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ed28870b000) 00010000:00010000:0.0:1787604104.395962:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787604104.395965:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b9ff4600, rc 0) 00000100:00100000:0.0:1787604104.396097:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+7:14423:x1874438345835136:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 2279us (2524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604104.396106:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15 00000100:00100000:3.0:1787604104.408479:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604104.408658:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345835392 00000100:00100000:0.0:1787604104.408668:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345835392 00000100:00100000:0.0:1787604104.408734:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:0.0:1787604104.408745:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+7:14423:x1874438345835392:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787604104.408765:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604104.408785:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5e9c expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.408894:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028ac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.408908:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.408918:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.408981:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.409013:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.409022:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.410297:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5a00/0xb5d1f3b1a19028ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.410314:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5a00/0xb5d1f3b1a19028ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.410323:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5a00/0xb5d1f3b1a19028ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787604104.410334:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787604104.411645:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411659:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028ac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411666:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411671:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff4e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604104.411676:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411682:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028ac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411710:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ed28870b000) 00010000:00010000:0.0:1787604104.411713:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604104.411718:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411724:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411736:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411741:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028b3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411746:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411750:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff5e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604104.411753:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411758:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028b3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411764:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ed28870b400) 00010000:00010000:0.0:1787604104.411766:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604104.411769:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028b3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.411773:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.412912:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e9c expref: 10 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.412936:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5a00/0xb5d1f3b1a19028ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e9c expref: 9 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.412944:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed28870ba00) 00010000:00010000:0.0:1787604104.412947:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604104.412950:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b9ff5a00, rc 0) 00000100:00100000:0.0:1787604104.413026:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+9:14423:x1874438345835392:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 4281us (4555us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787604104.413035:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:2.0:1787604104.421124:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604104.421214:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345835520 00000100:00100000:0.0:1787604104.421224:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345835520 00000100:00100000:0.0:1787604104.421286:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:0.0:1787604104.421297:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+9:14423:x1874438345835520:12345-192.168.202.21@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787604104.421416:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+9:14423:x1874438345835520:12345-192.168.202.21@tcp:59:lhsmtool_posix.0 Request processed in 120us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604104.421425:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:3.0:1787604104.509405:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604104.509563:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345835648 00000100:00100000:0.0:1787604104.509584:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345835648 00000100:00100000:0.0:1787604104.509652:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 18 00000100:00100000:0.0:1787604104.509663:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+9:14429:x1874438345835648:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787604104.509684:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604104.509706:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ea3 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.509792:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.509807:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.509819:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.509834:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.509885:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.509893:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510168:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510176:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510183:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510189:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff5e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604104.510193:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510212:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510225:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787604104.510228:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604104.510233:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510239:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510251:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510256:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510261:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510267:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff4e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604104.510269:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510275:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510282:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ed28870b400) 00010000:00010000:0.0:1787604104.510285:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604104.510287:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510317:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510350:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ea3 expref: 10 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510362:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787604104.510364:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604104.510367:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ea3 expref: 10 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.510376:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b9ff4a00, rc 0) 00000100:00100000:0.0:1787604104.510436:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+9:14429:x1874438345835648:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 774us (1043us total) trans 0 rc 301/301 00000100:00100000:0.0:1787604104.510443:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 18 00000100:00100000:3.0:1787604104.522505:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604104.523339:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345835776 00000100:00100000:1.0:1787604104.523351:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345835776 00000100:00100000:1.0:1787604104.523413:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:1.0:1787604104.523433:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:75376845-43d4-452b-be27-6d742e8a3513+9:14429:x1874438345835776:12345-192.168.202.21@tcp:700:lfs.0 00000100:00100000:1.0:1787604104.523518:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:75376845-43d4-452b-be27-6d742e8a3513+9:14429:x1874438345835776:12345-192.168.202.21@tcp:700:lfs.0 Request processed in 87us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604104.523526:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:3.0:1787604104.526057:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604104.527834:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345836032 00000100:00100000:0.0:1787604104.527862:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345836032 00000100:00100000:0.0:1787604104.527925:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:0.0:1787604104.527937:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+9:14429:x1874438345836032:12345-192.168.202.21@tcp:36:lfs.0 00010000:00010000:0.0:1787604104.527994:0:16376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604104.529138:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed298594e00/0xb5d1f3b1a190280b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e1e expref: 9 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.529161:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:0.0:1787604104.529626:0:16376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787604104.529932:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.529954:0:16376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217c400/0xb5d1f3b1a1902843 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e80 expref: 5 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.529964:0:16376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.530000:0:16376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217c400/0xb5d1f3b1a1902843 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e80 expref: 5 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.530565:0:16376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217c400/0xb5d1f3b1a1902843 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e80 expref: 5 pid: 14354 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604104.530591:0:16376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16376:1874438355262080:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787604104.530744:0:16376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed282be26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787604104.534239:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604104.535517:0:16376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16376:1874438355262080:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787604104.535557:0:16376:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604104.536085:0:16468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345836160 00000100:00100000:1.0:1787604104.536094:0:16468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345836160 00010000:00010000:1.0:1787604104.536136:0:16468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217c400/0xb5d1f3b1a1902843 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e80 expref: 6 pid: 14354 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604104.536185:0:16468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:1.0:1787604104.536195:0:16468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:2363:x1874438345836160:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604104.536210:0:16468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604104.536218:0:16468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217c400/0xb5d1f3b1a1902843 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e80 expref: 6 pid: 14354 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.536232:0:16468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217c400/0xb5d1f3b1a1902843 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e80 expref: 6 pid: 14354 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.536257:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217c400/0xb5d1f3b1a1902843 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5e80 expref: 6 pid: 14354 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.536275:0:16468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:1.0:1787604104.536293:0:16468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.536315:0:16468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.536324:0:16468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.536355:0:16468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604104.536475:0:16468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2363:x1874438345836160:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 215us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604104.536485:0:16468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 9 00010000:00010000:3.0:1787604104.537866:0:16376:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.537897:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.537923:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a19028e4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.537935:0:16376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a19028e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.537944:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a19028e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604104.546359:0:16376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787604104.546378:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.546388:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.546397:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.546403:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff4a00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604104.546408:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.547507:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.547528:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b800) 00010000:00010000:3.0:1787604104.547531:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604104.547549:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.547556:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4a00/0xb5d1f3b1a19028dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787604104.547590:0:16376:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3980281 reply state 000000008ab52a6f transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a19028e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604104.547601:0:16376:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787604104.547713:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+10:14429:x1874438345836032:12345-192.168.202.21@tcp:36:lfs.0 Request processed in 19774us (21661us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787604104.547722:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 19 00010000:00010000:1.0:1787604104.549677:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a19028e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.549693:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a19028e4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.549701:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a19028e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.549707:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217ce00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604104.549712:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a19028e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.549719:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a19028e4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.549733:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ed290d35700) 00010000:00010000:1.0:1787604104.549737:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604104.549751:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a19028e4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.549758:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217ce00/0xb5d1f3b1a19028e4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.664177:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604104.699901:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604104.700217:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345836288 00000100:00100000:0.0:1787604104.700228:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345836288 00000100:00100000:0.0:1787604104.700287:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00100000:0.0:1787604104.700297:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+9:14437:x1874438345836288:12345-192.168.202.21@tcp:101:lctl.0 00010000:00010000:0.0:1787604104.700321:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604104.700344:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5eaa expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.700411:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.700439:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.700450:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787604104.700510:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787604104.700514:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787604104.700557:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.700618:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a19028eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5eaa expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.700636:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5e00/0xb5d1f3b1a19028f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5eaa expref: 10 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.700646:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b400) 00010000:00010000:0.0:1787604104.700649:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787604104.700652:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b9ff5e00, rc 0) 00000100:00100000:0.0:1787604104.700718:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+10:14437:x1874438345836288:12345-192.168.202.21@tcp:101:lctl.0 Request processed in 422us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604104.700725:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00100000:3.0:1787604104.732256:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604104.732325:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345836416 00000100:00100000:1.0:1787604104.732335:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345836416 00000100:00100000:1.0:1787604104.732397:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 21 00000100:00100000:1.0:1787604104.732407:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:14438:x1874438345836416:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787604104.732430:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604104.732449:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a19028f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5eb1 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.732520:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e000/0xb5d1f3b1a1902900 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.732535:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e000/0xb5d1f3b1a1902900 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.732546:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e000/0xb5d1f3b1a1902900 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604104.732614:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787604104.732618:0:14352:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787604104.732646:0:14352:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e000/0xb5d1f3b1a1902900 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.732672:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a19028f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5eb1 expref: 7 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.732713:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e000/0xb5d1f3b1a1902900 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5eb1 expref: 6 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.732722:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b400) 00010000:00010000:1.0:1787604104.732726:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787604104.732729:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e000, rc 0) 00000100:00100000:1.0:1787604104.732798:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:14438:x1874438345836416:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 392us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604104.732805:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 21 00000100:00100000:3.0:1787604104.736514:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604104.736616:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345836544 00000100:00100000:0.0:1787604104.736626:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345836544 00000100:00100000:0.0:1787604104.736685:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 22 00000100:00100000:0.0:1787604104.736696:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:14438:x1874438345836544:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:0.0:1787604104.736717:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604104.736753:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902907 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5eb8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.736814:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a190290e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.736826:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a190290e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.736879:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a190290e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.736896:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902915 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.736903:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.736910:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737053:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5000/0xb5d1f3b1a190291c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737062:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5000/0xb5d1f3b1a190291c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737069:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5000/0xb5d1f3b1a190291c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787604104.737108:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787604104.737112:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787604104.737138:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5000/0xb5d1f3b1a190291c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737156:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a190290e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737163:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a190290e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737292:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a190290e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737299:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff4400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604104.737304:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a190290e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737312:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a190290e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737323:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b400) 00010000:00010000:0.0:1787604104.737326:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604104.737330:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a190290e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737337:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a190290e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737350:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737357:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902915 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737361:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902915 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737373:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff5400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604104.737377:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902915 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737383:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902915 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737392:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ed28870be00) 00010000:00010000:0.0:1787604104.737395:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604104.737398:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902915 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737403:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902915 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737434:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902907 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5eb8 expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737447:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5000/0xb5d1f3b1a190291c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5eb8 expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.737455:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ed28870bc00) 00010000:00010000:0.0:1787604104.737457:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787604104.737459:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b9ff5000, rc 0) 00000100:00100000:0.0:1787604104.737526:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+7:14438:x1874438345836544:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 832us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604104.737535:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 22 00000100:00100000:2.0:1787604104.744284:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604104.744610:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345836800 00000100:00100000:1.0:1787604104.744620:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345836800 00000100:00100000:1.0:1787604104.744681:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 23 00000100:00100000:1.0:1787604104.744690:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+7:14438:x1874438345836800:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787604104.744711:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604104.744730:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1902923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ebf expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604104.744877:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787604104.745361:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1902923 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ebf expref: 9 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.745377:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b400) 00010000:00010000:1.0:1787604104.745381:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787604104.745387:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1902923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ebf expref: 9 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.745418:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f800, rc 0) 00000100:00100000:1.0:1787604104.745482:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+8:14438:x1874438345836800:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 791us (1207us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787604104.745491:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 23 00000100:00100000:3.0:1787604104.748726:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604104.748794:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345837056 00000100:00100000:0.0:1787604104.748817:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345837056 00000100:00100000:0.0:1787604104.748904:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 24 00000100:00100000:0.0:1787604104.748915:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+8:14438:x1874438345837056:12345-192.168.202.21@tcp:36:lfs.0 00010000:00010000:0.0:1787604104.748971:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604104.748996:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5000/0xb5d1f3b1a190291c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5eb8 expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.749089:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ed28870bc00) 00010000:00010000:0.0:1787604104.749102:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787604104.749126:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902931 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.749139:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902931 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.749149:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902931 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787604104.749545:0:14354:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f858821 reply state 0000000037056cae transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902931 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604104.749556:0:14354:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787604104.749584:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1787604104.749801:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+9:14438:x1874438345837056:12345-192.168.202.21@tcp:36:lfs.0 Request processed in 886us (1083us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787604104.749810:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 24 00000100:00100000:1.0:1787604104.760920:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604104.761211:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345837312 00000100:00100000:0.0:1787604104.761223:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345837312 00000100:00100000:0.0:1787604104.761279:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 2 00000100:00100000:0.0:1787604104.761291:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+9:14438:x1874438345837312:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:0.0:1787604104.761584:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+10:14438:x1874438345837312:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 294us (674us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787604104.761593:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 2 00010000:00010000:3.0:1787604104.761905:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902931 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.761919:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902931 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.761927:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902931 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.761933:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff4e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604104.761938:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902931 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.761946:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902931 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.761974:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ed28870be00) 00010000:00010000:3.0:1787604104.761978:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787604104.761982:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902931 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.761988:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4e00/0xb5d1f3b1a1902931 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604104.776635:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604104.776746:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345837568 00000100:00100000:3.0:1787604104.776756:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345837568 00000100:00100000:1.0:1787604104.777091:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 25 00000100:00100000:1.0:1787604104.777104:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+9:14438:x1874438345837568:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787604104.777129:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604104.777152:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1902938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ec6 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777242:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190293f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777256:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190293f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777268:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190293f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777281:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902946 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777288:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777294:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604104.777444:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787604104.777541:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190293f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777549:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190293f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777557:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190293f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777563:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604104.777577:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190293f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777586:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190293f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777599:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b400) 00010000:00010000:1.0:1787604104.777602:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604104.777607:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190293f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777613:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a190293f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777627:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777633:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902946 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777650:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777655:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604104.777658:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777665:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902946 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777673:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ed291bd5800) 00010000:00010000:1.0:1787604104.777676:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604104.777679:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902946 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777684:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902946 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777720:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1902938 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ec6 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777730:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b400) 00010000:00010000:1.0:1787604104.777733:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787604104.777736:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f800/0xb5d1f3b1a1902938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ec6 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.777745:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f800, rc 0) 00000100:00100000:1.0:1787604104.777808:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+10:14438:x1874438345837568:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 707us (1183us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787604104.777826:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 25 00000100:00100000:0.0:1787604104.780658:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604104.780719:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345837696 00000100:00100000:1.0:1787604104.780728:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345837696 00000100:00100000:1.0:1787604104.780770:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 26 00000100:00100000:1.0:1787604104.780777:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+10:14438:x1874438345837696:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:1.0:1787604104.780795:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604104.780811:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902954 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ecd expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.780905:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190295b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.780917:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190295b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.780925:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190295b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604104.780961:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787604104.780963:0:14353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787604104.780977:0:14353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190295b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.780996:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902954 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ecd expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.781017:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190295b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ecd expref: 11 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.781037:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ed291bd5300) 00010000:00010000:1.0:1787604104.781039:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787604104.781042:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f000, rc 0) 00000100:00100000:1.0:1787604104.781082:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+11:14438:x1874438345837696:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 305us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604104.781089:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 26 00000100:00100000:3.0:1787604104.785024:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604104.785088:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345837824 00000100:00100000:0.0:1787604104.785098:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345837824 00000100:00100000:0.0:1787604104.785147:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3 00000100:00100000:0.0:1787604104.785157:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+11:14438:x1874438345837824:12345-192.168.202.21@tcp:37:lfs.0 00000100:00100000:0.0:1787604104.789753:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+11:14438:x1874438345837824:12345-192.168.202.21@tcp:37:lfs.0 Request processed in 4585us (4727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604104.789767:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3 00000100:00100000:3.0:1787604104.794121:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604104.794215:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345838080 00000100:00100000:2.0:1787604104.794226:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345838080 00000100:00100000:2.0:1787604104.794289:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:2.0:1787604104.794300:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ea6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+11:14438:x1874438345838080:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:2.0:1787604104.794791:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ea6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+12:14438:x1874438345838080:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 492us (678us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787604104.794800:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:3.0:1787604104.885975:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604104.886311:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345838208 00000100:00100000:1.0:1787604104.886324:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345838208 00000100:00100000:1.0:1787604104.886400:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 27 00000100:00100000:1.0:1787604104.886593:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+10:14444:x1874438345838208:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:1.0:1787604104.886617:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604104.886639:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902962 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ed4 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.886704:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902969 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.886718:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902969 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.886730:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902969 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.886746:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902970 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.886754:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.886782:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.886944:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ea00/0xb5d1f3b1a1902977 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.886954:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ea00/0xb5d1f3b1a1902977 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.886961:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ea00/0xb5d1f3b1a1902977 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604104.886995:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787604104.887009:0:14352:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787604104.887056:0:14352:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ea00/0xb5d1f3b1a1902977 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.887069:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902969 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.887075:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902969 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.887082:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902969 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.887905:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604104.887911:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902969 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.887918:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902969 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.887944:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b400) 00010000:00010000:1.0:1787604104.887947:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604104.887952:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902969 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.887959:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a1902969 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.887972:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.887979:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902970 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.887985:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902970 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.887990:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604104.887993:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902970 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.888011:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902970 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.888020:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ed291bd5800) 00010000:00010000:1.0:1787604104.888023:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604104.888026:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902970 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.888032:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902970 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.888082:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ec00/0xb5d1f3b1a1902962 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ed4 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.888630:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7ea00/0xb5d1f3b1a1902977 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ed4 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604104.888638:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ed291bd5300) 00010000:00010000:1.0:1787604104.888640:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787604104.888643:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7ea00, rc 0) 00000100:00100000:1.0:1787604104.888717:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+11:14444:x1874438345838208:12345-192.168.202.21@tcp:101:bash.0 Request processed in 2306us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604104.888726:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 27 00000100:00100000:1.0:1787604104.894944:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604104.895110:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345838464 00000100:00100000:0.0:1787604104.895122:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345838464 00000100:00100000:0.0:1787604104.895197:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 28 00000100:00100000:0.0:1787604104.895208:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+11:14444:x1874438345838464:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:0.0:1787604104.895228:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604104.895248:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a190297e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5edb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.895812:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.895831:0:14353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190295b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ecd expref: 11 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.895867:0:14353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.895920:0:14353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190295b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ecd expref: 11 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604104.895934:0:14353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190295b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ecd expref: 11 pid: 14353 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604104.895948:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874438355262208:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787604104.896095:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed290c44e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787604104.900787:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604104.900888:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874438355262208:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787604104.900913:0:14353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604104.901012:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345838592 00000100:00100000:2.0:1787604104.901032:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345838592 00010000:00010000:2.0:1787604104.901069:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190295b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ecd expref: 12 pid: 14353 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604104.901126:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:2.0:1787604104.901136:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+12:2363:x1874438345838592:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787604104.901150:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604104.901157:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190295b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ecd expref: 12 pid: 14353 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.901180:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190295b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ecd expref: 12 pid: 14353 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.901205:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7f000/0xb5d1f3b1a190295b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ecd expref: 12 pid: 14353 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.901221:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ed291bd5300) 00010000:00010000:2.0:1787604104.901227:0:14337:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.901236:0:14337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.901244:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.901267:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604104.902774:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+11:2363:x1874438345838592:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 1632us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604104.902802:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 10 00010000:00010000:2.0:1787604104.902858:0:14353:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.902868:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.902897:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a190298c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.902908:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a190298c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.902917:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a190298c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.908079:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1902993 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.908103:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1902993 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.908116:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1902993 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604104.908130:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787604104.908550:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.908560:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.908596:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.908603:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff4400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787604104.908607:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.908615:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.908629:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ed291bd5300) 00010000:00010000:2.0:1787604104.908632:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604104.908637:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.908643:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902985 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787604104.908659:0:14353:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4853005 reply state 00000000b9b5d523 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a190298c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604104.908669:0:14353:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787604104.908709:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a190297e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5edb expref: 14 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.908724:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1902993 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5edb expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.908731:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:2.0:1787604104.908740:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787604104.908742:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963a00, rc 0) 00000100:00100000:2.0:1787604104.908811:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+14:14444:x1874438345838464:12345-192.168.202.21@tcp:101:bash.0 Request processed in 13604us (13877us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787604104.908820:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 28 00000040:00080000:3.0:1787604104.921747:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787604104.924813:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a190298c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.924849:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a190298c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.924857:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a190298c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.924864:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963000 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604104.924869:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a190298c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.924877:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a190298c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.924917:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ed2b2e8b400) 00010000:00010000:3.0:1787604104.924921:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604104.924926:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a190298c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604104.924932:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963000/0xb5d1f3b1a190298c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604104.937775:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604104.938690:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345838720 00000100:00100000:2.0:1787604104.938702:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345838720 00000100:00100000:2.0:1787604104.938766:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 29 00000100:00100000:2.0:1787604104.938776:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+13:14444:x1874438345838720:12345-192.168.202.21@tcp:101:bash.0 00010000:00010000:2.0:1787604104.938798:0:16376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604104.938820:0:16376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19029a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ee2 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.938928:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.938943:0:16376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.938955:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604104.938993:0:16376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787604104.939008:0:16376:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787604104.939029:0:16376:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.939041:0:16376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.939064:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19029a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ee2 expref: 15 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.939118:0:16376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ee2 expref: 14 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604104.939125:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:2.0:1787604104.939128:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787604104.939131:0:16376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963200, rc 0) 00000100:00100000:2.0:1787604104.939194:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+14:14444:x1874438345838720:12345-192.168.202.21@tcp:101:bash.0 Request processed in 419us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604104.939202:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 29 00000100:00100000:1.0:1787604104.949995:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604104.950112:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345838976 00000100:00100000:2.0:1787604104.950123:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345838976 00000100:00100000:2.0:1787604104.950193:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:2.0:1787604104.950205:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75376845-43d4-452b-be27-6d742e8a3513+14:14444:x1874438345838976:12345-192.168.202.21@tcp:35:bash.0 00000100:00100000:2.0:1787604104.951106:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75376845-43d4-452b-be27-6d742e8a3513+15:14444:x1874438345838976:12345-192.168.202.21@tcp:35:bash.0 Request processed in 900us (1116us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787604104.951116:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:3.0:1787604105.124341:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604105.124515:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345839232 00000100:00100000:2.0:1787604105.124525:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345839232 00000100:00100000:2.0:1787604105.124634:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00100000:2.0:1787604105.124647:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+15:14454:x1874438345839232:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:2.0:1787604105.124672:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604105.124693:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19029af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ee9 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604105.124809:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787604105.124981:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19029af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ee9 expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.124996:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed28870b400) 00010000:00010000:2.0:1787604105.125000:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787604105.125005:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19029af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ee9 expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.125020:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963600, rc 0) 00000100:00100000:2.0:1787604105.125082:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+16:14454:x1874438345839232:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 439us (750us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787604105.125090:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00080000:0.0:1787604105.125503:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787604105.132898:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604105.132984:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345839488 00000100:00100000:3.0:1787604105.132995:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345839488 00000100:00100000:3.0:1787604105.133055:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:3.0:1787604105.133066:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75376845-43d4-452b-be27-6d742e8a3513+16:14454:x1874438345839488:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:3.0:1787604105.133525:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75376845-43d4-452b-be27-6d742e8a3513+17:14454:x1874438345839488:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 459us (635us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787604105.133534:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:3.0:1787604105.232514:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604105.232702:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345839744 00000100:00100000:2.0:1787604105.232713:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345839744 00000100:00100000:2.0:1787604105.232771:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 31 00000100:00100000:2.0:1787604105.232782:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+17:14457:x1874438345839744:12345-192.168.202.21@tcp:101:lfs.0 00010000:00010000:2.0:1787604105.232807:0:16376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604105.232827:0:16376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19029bd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ef0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.232961:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963800/0xb5d1f3b1a19029c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.232975:0:16376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963800/0xb5d1f3b1a19029c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.232988:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963800/0xb5d1f3b1a19029c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604105.233019:0:16376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787604105.233149:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a19029bd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ef0 expref: 20 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.233560:0:16376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963800/0xb5d1f3b1a19029c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ef0 expref: 19 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.233579:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:2.0:1787604105.233582:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787604105.233584:0:16376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963800, rc 0) 00000100:00100000:2.0:1787604105.233647:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+19:14457:x1874438345839744:12345-192.168.202.21@tcp:101:lfs.0 Request processed in 867us (1141us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787604105.233655:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 31 00000100:00100000:1.0:1787604105.237693:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604105.238164:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345839872 00000100:00100000:2.0:1787604105.238175:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345839872 00000100:00100000:2.0:1787604105.238238:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 32 00000100:00100000:2.0:1787604105.238249:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+19:14457:x1874438345839872:12345-192.168.202.21@tcp:54:lfs.0 00010000:00010000:2.0:1787604105.238330:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a19029d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.238347:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a19029d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.238358:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a19029d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.238385:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a19029d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.238733:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a19029d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.238744:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a19029d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.238749:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787604105.238753:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a19029d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.238760:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a19029d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.238774:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:2.0:1787604105.238777:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787604105.238781:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a19029d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.238787:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a19029d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604105.238889:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+19:14457:x1874438345839872:12345-192.168.202.21@tcp:54:lfs.0 Request processed in 641us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604105.238897:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 32 00000100:00100000:0.0:1787604105.243063:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604105.243119:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604105.243330:0:16468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345840000 00000100:00100000:1.0:1787604105.243340:0:16468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345840000 00000100:00100000:1.0:1787604105.243424:0:16468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:1.0:1787604105.243436:0:16468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75376845-43d4-452b-be27-6d742e8a3513+19:2365:x1874438345840000:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604105.243451:0:16468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604105.243476:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963800/0xb5d1f3b1a19029c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ef0 expref: 19 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.243518:0:16468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:1.0:1787604105.243523:0:16468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604105.243592:0:16468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75376845-43d4-452b-be27-6d742e8a3513+18:2365:x1874438345840000:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 158us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604105.243600:0:16468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:3.0:1787604105.244198:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345840256 00000100:00100000:3.0:1787604105.244205:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345840256 00000100:00100000:3.0:1787604105.244244:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:3.0:1787604105.244253:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75376845-43d4-452b-be27-6d742e8a3513+18:14457:x1874438345840256:12345-192.168.202.21@tcp:35:lfs.0 00000100:00100000:3.0:1787604105.244466:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75376845-43d4-452b-be27-6d742e8a3513+19:14457:x1874438345840256:12345-192.168.202.21@tcp:35:lfs.0 Request processed in 214us (1345us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787604105.244473:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:0.0:1787604105.625855:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604105.628373:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345840512 00000100:00100000:1.0:1787604105.628389:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345840512 00000100:00100000:1.0:1787604105.628463:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 33 00000100:00100000:1.0:1787604105.628473:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+19:14488:x1874438345840512:12345-192.168.202.21@tcp:101:cat.0 00010000:00010000:1.0:1787604105.628495:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604105.628514:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5ef7 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.628617:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19029e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.628632:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19029e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.628643:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19029e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604105.628653:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787604105.628805:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ef7 expref: 22 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.628825:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19029e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ef7 expref: 21 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.628896:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:1.0:1787604105.628899:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787604105.628903:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e400, rc 0) 00000100:00100000:1.0:1787604105.628968:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+21:14488:x1874438345840512:12345-192.168.202.21@tcp:101:cat.0 Request processed in 496us (3141us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787604105.628975:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 33 00000100:00100000:3.0:1787604105.633896:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604105.633986:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345840640 00000100:00100000:1.0:1787604105.633997:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345840640 00000100:00100000:1.0:1787604105.634065:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1 00000100:00100000:1.0:1787604105.634077:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75376845-43d4-452b-be27-6d742e8a3513+21:2365:x1874438345840640:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604105.634097:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604105.634124:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19029e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ef7 expref: 21 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.634143:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:1.0:1787604105.634149:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604105.634226:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75376845-43d4-452b-be27-6d742e8a3513+20:2365:x1874438345840640:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 150us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604105.634233:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1 00000100:00100000:3.0:1787604105.636110:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604105.636315:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345840896 00000100:00100000:2.0:1787604105.636322:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345840896 00000100:00100000:2.0:1787604105.636365:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 8 00000100:00100000:2.0:1787604105.636371:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75376845-43d4-452b-be27-6d742e8a3513+20:14488:x1874438345840896:12345-192.168.202.21@tcp:35:cat.0 00000100:00100000:2.0:1787604105.636998:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75376845-43d4-452b-be27-6d742e8a3513+21:14488:x1874438345840896:12345-192.168.202.21@tcp:35:cat.0 Request processed in 623us (892us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787604105.637014:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 8 00010000:00010000:0.0:1787604105.689915:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604105.711615:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604105.711738:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345841152 00000100:00100000:1.0:1787604105.711747:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345841152 00000100:00100000:1.0:1787604105.711796:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 34 00000100:00100000:1.0:1787604105.711804:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+21:14494:x1874438345841152:12345-192.168.202.21@tcp:101:dd.0 00010000:00010000:1.0:1787604105.711826:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604105.711872:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19029ee lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5efe expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.711970:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.711981:0:14353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1902993 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5edb expref: 22 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.711986:0:14353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ee2 expref: 22 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.711991:0:14353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029f5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.712016:0:14353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ee2 expref: 22 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.712025:0:14353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ee2 expref: 22 pid: 16376 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604105.712034:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874438355262336:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787604105.712127:0:14353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1902993 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5edb expref: 22 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.712137:0:14353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1902993 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5edb expref: 22 pid: 14353 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604105.712146:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed287b4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874438355262464:192.168.202.21@tcp:104: 00000100:00100000:1.0:1787604105.712192:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2865a7780 going to sleep for 11 seconds 00000100:00100000:3.0:1787604105.716670:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604105.716944:0:16468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345841280 00000100:00100000:0.0:1787604105.716955:0:16468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345841280 00010000:00010000:0.0:1787604105.717001:0:16468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ee2 expref: 23 pid: 16376 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604105.717048:0:16468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:0.0:1787604105.717059:0:16468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75376845-43d4-452b-be27-6d742e8a3513+23:2363:x1874438345841280:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604105.717073:0:16468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604105.717081:0:16468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ee2 expref: 23 pid: 16376 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.717114:0:16468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ee2 expref: 23 pid: 16376 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.717137:0:16468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:0.0:1787604105.717143:0:16468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.717161:0:16468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.717177:0:16468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604105.717236:0:16468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75376845-43d4-452b-be27-6d742e8a3513+23:2363:x1874438345841280:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 178us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604105.717243:0:16468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:3.0:1787604105.718538:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604105.718663:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345841408 00000100:00100000:0.0:1787604105.718669:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345841408 00010000:00010000:0.0:1787604105.718690:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1902993 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5edb expref: 23 pid: 14353 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604105.718715:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:0.0:1787604105.718722:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2b9df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75376845-43d4-452b-be27-6d742e8a3513+23:2364:x1874438345841408:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604105.718729:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604105.718733:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1902993 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5edb expref: 23 pid: 14353 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.718741:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1902993 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5edb expref: 23 pid: 14353 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.718763:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:0.0:1787604105.718766:0:14339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.718773:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.718777:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029f5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.718791:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604105.718826:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2b9df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75376845-43d4-452b-be27-6d742e8a3513+23:2364:x1874438345841408:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 104us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604105.718830:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 12 00010000:00010000:1.0:1787604105.720845:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963200/0xb5d1f3b1a19029a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5ee2 expref: 22 pid: 16376 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604105.720865:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874438355262336:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787604105.720874:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963a00/0xb5d1f3b1a1902993 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5edb expref: 21 pid: 14353 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604105.720880:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed287b4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874438355262464:192.168.202.21@tcp:104: 00010000:00010000:1.0:1787604105.720899:0:14353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.720906:0:14353:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.720909:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604105.720927:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787604105.721591:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a19029ee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5efe expref: 22 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.721608:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e800/0xb5d1f3b1a19029f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5efe expref: 21 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.721616:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:1.0:1787604105.721619:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787604105.721622:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7e800, rc 0) 00000100:00100000:1.0:1787604105.721769:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+21:14494:x1874438345841152:12345-192.168.202.21@tcp:101:dd.0 Request processed in 9963us (10161us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787604105.721777:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 34 00000100:00100000:3.0:1787604105.726632:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604105.727457:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345841664 00000100:00100000:1.0:1787604105.727469:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345841664 00000100:00100000:1.0:1787604105.727657:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 35 00000100:00100000:1.0:1787604105.727666:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+21:14494:x1874438345841664:12345-192.168.202.21@tcp:36:dd.0 00010000:00010000:1.0:1787604105.727905:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902a03 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.727920:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902a03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.727928:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902a03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787604105.727965:0:14352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787604105.727982:0:14352:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bb42a38 reply state 00000000ae50aeea transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902a03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604105.727989:0:14352:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787604105.728080:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+24:14494:x1874438345841664:12345-192.168.202.21@tcp:36:dd.0 Request processed in 415us (1458us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787604105.728087:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 35 00000020:00080000:1.0:1787604105.728092:0:14352:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787604105.729786:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902a03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.729799:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902a03 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.729822:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902a03 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.729829:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7e400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604105.729833:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902a03 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.729939:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902a03 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.729956:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:1.0:1787604105.729959:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604105.729963:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902a03 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604105.729969:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2bec7e400/0xb5d1f3b1a1902a03 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604105.730926:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604105.731135:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345841792 00000100:00100000:2.0:1787604105.731144:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345841792 00000100:00100000:2.0:1787604105.731214:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 36 00000100:00100000:2.0:1787604105.731225:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+23:14494:x1874438345841792:12345-192.168.202.21@tcp:101:dd.0 00010000:00010000:2.0:1787604105.731248:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604105.731265:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1902a0a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5f05 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.731318:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1902a0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f05 expref: 24 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.731328:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1902a0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f05 expref: 24 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.731340:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:2.0:1787604105.731342:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787604105.731344:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963400, rc 0) 00000100:00100000:2.0:1787604105.731392:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+24:14494:x1874438345841792:12345-192.168.202.21@tcp:101:dd.0 Request processed in 171us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604105.731398:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 36 00000100:00100000:3.0:1787604105.756665:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604105.764931:0:16468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345842048 00000100:00100000:0.0:1787604105.764949:0:16468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345842048 00000100:00100000:0.0:1787604105.765049:0:16468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 2 00000100:00100000:0.0:1787604105.765063:0:16468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75376845-43d4-452b-be27-6d742e8a3513+24:14494:x1874438345842048:12345-192.168.202.21@tcp:103:dd.0 00010000:00010000:0.0:1787604105.765088:0:16468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604105.765114:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963400/0xb5d1f3b1a1902a0a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f05 expref: 24 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.765135:0:16468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:0.0:1787604105.765141:0:16468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604105.765419:0:16468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75376845-43d4-452b-be27-6d742e8a3513+23:14494:x1874438345842048:12345-192.168.202.21@tcp:103:dd.0 Request processed in 358us (8760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604105.765438:0:16468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 2 00000100:00100000:3.0:1787604105.769017:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604105.769077:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345842176 00000100:00100000:2.0:1787604105.769142:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345842176 00000100:00100000:2.0:1787604105.771368:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 37 00000100:00100000:2.0:1787604105.771384:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+23:14494:x1874438345842176:12345-192.168.202.21@tcp:58:dd.0 00010000:00010000:2.0:1787604105.771498:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1902a11 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.771529:0:16376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1902a11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604105.771539:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1902a11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787604105.772323:0:16376:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787604105.772476:0:16376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787604105.772543:0:16376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787604105.772880:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+23:14494:x1874438345842176:12345-192.168.202.21@tcp:58:dd.0 Request processed in 1495us (3864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604105.772890:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 37 00000100:00100000:3.0:1787604105.775715:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604105.777746:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345842304 00000100:00100000:2.0:1787604105.777760:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345842304 00000100:00100000:0.0:1787604105.777829:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 38 00000100:00100000:0.0:1787604105.777876:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+23:14494:x1874438345842304:12345-192.168.202.21@tcp:101:dd.0 00010000:00010000:0.0:1787604105.777896:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604105.777916:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4800/0xb5d1f3b1a1902a18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5f0c expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.777970:0:14353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1902a11 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.777980:0:14353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4800/0xb5d1f3b1a1902a18 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f0c expref: 24 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.777998:0:14353:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1902a11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.778011:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4800/0xb5d1f3b1a1902a18 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f0c expref: 24 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.778024:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:0.0:1787604105.778027:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787604105.778031:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4800/0xb5d1f3b1a1902a18 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f0c expref: 24 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604105.778039:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b9ff4800, rc 0) 00000100:00100000:0.0:1787604105.778095:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+24:14494:x1874438345842304:12345-192.168.202.21@tcp:101:dd.0 Request processed in 257us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604105.778102:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 38 00000040:00080000:3.0:1787604105.943110:0:14384:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787604105.943120:0:14384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787604105.943185:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787604105.943192:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787604105.943346:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf6daa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14384:1874438355262592:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787604105.943463:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed284e39f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604105.955803:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf6daa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14384:1874438355262592:192.168.202.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787604105.967488:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604105.968186:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345842432 00000100:00100000:0.0:1787604105.968197:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345842432 00000100:00100000:0.0:1787604105.968255:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:0.0:1787604105.968265:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:75376845-43d4-452b-be27-6d742e8a3513+24:14495:x1874438345842432:12345-192.168.202.21@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787604105.968463:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:75376845-43d4-452b-be27-6d742e8a3513+24:14495:x1874438345842432:12345-192.168.202.21@tcp:900:lhsmtool_posix.0 Request processed in 198us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604105.968471:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:3.0:1787604105.976610:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604105.976799:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345842560 00000100:00100000:2.0:1787604105.976809:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345842560 00000100:00100000:2.0:1787604105.976901:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 39 00000100:00100000:2.0:1787604105.976912:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+24:14495:x1874438345842560:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787604105.976944:0:14353:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787604105.977058:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+24:14495:x1874438345842560:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 Request processed in 148us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604105.977067:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 39 00000100:00100000:3.0:1787604105.996411:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.002384:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345842688 00000100:00100000:0.0:1787604106.002406:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345842688 00000100:00100000:0.0:1787604106.002881:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 40 00000100:00100000:0.0:1787604106.002893:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+24:14495:x1874438345842688:12345-192.168.202.21@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787604106.002969:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5800/0xb5d1f3b1a1902a1f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.002987:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5800/0xb5d1f3b1a1902a1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003001:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5800/0xb5d1f3b1a1902a1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003052:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4200/0xb5d1f3b1a1902a26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003060:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4200/0xb5d1f3b1a1902a26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003068:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4200/0xb5d1f3b1a1902a26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003111:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a2d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003121:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003128:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787604106.003166:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787604106.003170:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787604106.003622:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003636:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5800/0xb5d1f3b1a1902a1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003644:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5800/0xb5d1f3b1a1902a1f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003651:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5800/0xb5d1f3b1a1902a1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003657:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff5800 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604106.003661:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5800/0xb5d1f3b1a1902a1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003669:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5800/0xb5d1f3b1a1902a1f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003682:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed28870ba00) 00010000:00010000:0.0:1787604106.003693:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604106.003698:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5800/0xb5d1f3b1a1902a1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003715:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5800/0xb5d1f3b1a1902a1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003730:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4200/0xb5d1f3b1a1902a26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003736:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4200/0xb5d1f3b1a1902a26 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003742:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4200/0xb5d1f3b1a1902a26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003747:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff4200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604106.003750:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4200/0xb5d1f3b1a1902a26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003755:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4200/0xb5d1f3b1a1902a26 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003763:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ed28870bc00) 00010000:00010000:0.0:1787604106.003765:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604106.003768:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4200/0xb5d1f3b1a1902a26 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003772:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4200/0xb5d1f3b1a1902a26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003786:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003796:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a2d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003801:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003806:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff5200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604106.003809:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003814:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a2d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003821:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:0.0:1787604106.003823:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604106.003825:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a2d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.003830:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604106.004183:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+24:14495:x1874438345842688:12345-192.168.202.21@tcp:34:lhsmtool_posix.0 Request processed in 1290us (7779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604106.004193:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 40 00000100:00100000:1.0:1787604106.010757:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.011106:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345842944 00000100:00100000:0.0:1787604106.011117:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345842944 00000100:00100000:0.0:1787604106.011181:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 41 00000100:00100000:0.0:1787604106.011191:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+24:14495:x1874438345842944:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787604106.011212:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604106.011244:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5f13 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.011348:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.011363:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.011375:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787604106.011386:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787604106.011507:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.011515:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a3b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.011522:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.011529:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff5400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604106.011533:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.011540:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a3b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.011553:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:0.0:1787604106.011566:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787604106.011571:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a3b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.011587:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a3b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.011636:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a34 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f13 expref: 26 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.011645:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ed28870ba00) 00010000:00010000:0.0:1787604106.011647:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787604106.011651:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f13 expref: 26 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.011659:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b9ff5600, rc 0) 00000100:00100000:0.0:1787604106.011716:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+25:14495:x1874438345842944:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 527us (968us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1787604106.011723:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 41 00000100:00100000:1.0:1787604106.027802:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604106.027929:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345843072 00000100:00100000:2.0:1787604106.027940:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345843072 00000100:00100000:2.0:1787604106.028002:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 42 00000100:00100000:2.0:1787604106.028013:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+25:14495:x1874438345843072:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787604106.028049:0:16376:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787604106.028174:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+25:14495:x1874438345843072:12345-192.168.202.21@tcp:53:lhsmtool_posix.0 Request processed in 162us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604106.028183:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 42 00000100:00100000:1.0:1787604106.031527:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.039073:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345843328 00000100:00100000:0.0:1787604106.039091:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345843328 00000100:00100000:0.0:1787604106.039163:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 43 00000100:00100000:0.0:1787604106.039175:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+25:14495:x1874438345843328:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787604106.039195:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604106.039217:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a49 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5f1a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787604106.040122:0:14353:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:0.0:1787604106.040130:0:14353:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1787604106.040180:0:14353:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787604106.045833:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.045890:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.045903:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.045979:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a49 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f1a expref: 28 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.046000:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f1a expref: 27 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.046010:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ed28870bc00) 00010000:00010000:0.0:1787604106.046013:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787604106.046016:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b9ff5400, rc 0) 00000100:00100000:0.0:1787604106.046097:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+27:14495:x1874438345843328:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 6912us (14567us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787604106.046107:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 43 00000100:00100000:1.0:1787604106.055052:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604106.055145:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345843584 00000100:00100000:2.0:1787604106.055155:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345843584 00000100:00100000:2.0:1787604106.055216:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 44 00000100:00100000:2.0:1787604106.055227:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+27:14495:x1874438345843584:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787604106.055285:0:16376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604106.055416:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5400/0xb5d1f3b1a1902a50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f1a expref: 27 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055528:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ed28870bc00) 00010000:00010000:2.0:1787604106.055539:0:16376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787604106.055572:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a5e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055584:0:16376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055593:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055607:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902a65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2b12cede bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055613:0:16376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902a65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b12cede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055618:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902a65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b12cede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055706:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055714:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a5e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055721:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a5e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055727:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962e00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787604106.055732:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a5e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055739:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a5e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055748:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ed291bd5300) 00010000:00010000:2.0:1787604106.055751:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604106.055755:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a5e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055761:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a5e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055771:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902a65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b12cede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055776:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902a65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b12cede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055782:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902a65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b12cede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055794:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962c00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:2.0:1787604106.055796:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902a65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b12cede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055802:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902a65 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b12cede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055810:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2b12cede (ffff9ed2b2e8b700) 00010000:00010000:2.0:1787604106.055812:0:16376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604106.055815:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902a65 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2b12cede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.055821:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902a65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2b12cede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604106.056019:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+26:14495:x1874438345843584:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 793us (975us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787604106.056026:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 44 00000100:00100000:1.0:1787604106.060188:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604106.060277:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345843712 00000100:00100000:3.0:1787604106.060296:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345843712 00000100:00100000:3.0:1787604106.060355:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 45 00000100:00100000:3.0:1787604106.060365:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+26:14495:x1874438345843712:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787604106.060385:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604106.060408:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217de00/0xb5d1f3b1a1902a6c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5f21 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.060456:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217dc00/0xb5d1f3b1a1902a73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.060469:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217dc00/0xb5d1f3b1a1902a73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.060498:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217dc00/0xb5d1f3b1a1902a73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.060607:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217de00/0xb5d1f3b1a1902a6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f21 expref: 28 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.060626:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2c217dc00/0xb5d1f3b1a1902a73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f21 expref: 27 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.060634:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:3.0:1787604106.060637:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787604106.060639:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2c217dc00, rc 0) 00000100:00100000:3.0:1787604106.060700:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+27:14495:x1874438345843712:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 337us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604106.065200:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 45 00000100:00100000:1.0:1787604106.075367:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.075649:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345843968 00000100:00100000:0.0:1787604106.075660:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345843968 00000100:00100000:0.0:1787604106.075734:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 46 00000100:00100000:0.0:1787604106.075746:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+27:14495:x1874438345843968:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787604106.075830:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a7a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.075886:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.075915:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787604106.076652:0:14354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1787604106.076665:0:14354:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 439140826476ns, next at 440140824061ns, rc = 0 00000004:00010000:1.0:1787604106.076760:0:14354:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9cb0ad2 reply state 000000007ac4f01a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604106.076784:0:14354:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787604106.076918:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75376845-43d4-452b-be27-6d742e8a3513+29:14495:x1874438345843968:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 1173us (1560us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787604106.076926:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 46 00010000:00010000:3.0:1787604106.078877:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.078892:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a7a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.078899:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.078905:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff5600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:3.0:1787604106.078909:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.078917:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a7a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.078947:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:3.0:1787604106.078950:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787604106.078955:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a7a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.078961:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5600/0xb5d1f3b1a1902a7a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604106.080516:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604106.080602:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345844096 00000100:00100000:2.0:1787604106.080613:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345844096 00000100:00100000:2.0:1787604106.080666:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 47 00000100:00100000:2.0:1787604106.080677:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed287b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+28:14495:x1874438345844096:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787604106.080821:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604106.080863:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5f28 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.080922:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f28 expref: 29 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.080954:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f28 expref: 29 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.080974:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:2.0:1787604106.080978:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787604106.080981:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4962e00, rc 0) 00000100:00100000:2.0:1787604106.081045:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed287b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+29:14495:x1874438345844096:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 370us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604106.081052:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 47 00000100:00100000:1.0:1787604106.086961:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.087310:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345844224 00000100:00100000:0.0:1787604106.087321:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345844224 00000100:00100000:0.0:1787604106.087396:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:0.0:1787604106.087409:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75376845-43d4-452b-be27-6d742e8a3513+5:2363:x1874438345844224:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787604106.087890:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787604106.093616:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75376845-43d4-452b-be27-6d742e8a3513+6:2363:x1874438345844224:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 Request processed in 6199us (6654us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787604106.093631:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 12 00000100:00100000:1.0:1787604106.103529:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604106.108599:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345844480 00000100:00100000:2.0:1787604106.108614:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345844480 00000100:00100000:2.0:1787604106.108699:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:2.0:1787604106.108951:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75376845-43d4-452b-be27-6d742e8a3513+29:14495:x1874438345844480:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787604106.109222:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75376845-43d4-452b-be27-6d742e8a3513+30:14495:x1874438345844480:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 274us (5707us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787604106.113329:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.113507:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345844736 00000100:00100000:0.0:1787604106.113517:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345844736 00000100:00100000:0.0:1787604106.113583:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 48 00000100:00100000:0.0:1787604106.113594:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+31:14495:x1874438345844736:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787604106.113722:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+31:14495:x1874438345844736:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 129us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604106.113729:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 48 00000100:00100000:2.0:1787604106.114680:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 9 00000100:00100000:1.0:1787604106.122368:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604106.122574:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345844864 00000100:00100000:2.0:1787604106.122585:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345844864 00000100:00100000:2.0:1787604106.122648:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 49 00000100:00100000:2.0:1787604106.122660:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+30:14495:x1874438345844864:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787604106.122697:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604106.122729:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902a88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5f2f expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.122814:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1902a8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.122828:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1902a8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.123022:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1902a8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604106.123062:0:14353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787604106.123082:0:14353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1902a8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.123110:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902a88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f2f expref: 32 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.123127:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1902a8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f2f expref: 31 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.123136:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:2.0:1787604106.123211:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787604106.123215:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963e00, rc 0) 00000100:00100000:2.0:1787604106.123279:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+31:14495:x1874438345844864:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 621us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604106.123347:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 49 00000100:00100000:3.0:1787604106.128492:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604106.128884:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345844992 00000100:00100000:1.0:1787604106.128894:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345844992 00000100:00100000:1.0:1787604106.128941:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:1.0:1787604106.128950:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2bf6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75376845-43d4-452b-be27-6d742e8a3513+6:2364:x1874438345844992:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787604106.128968:0:15036:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604106.128989:0:15036:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000048df128/0xb5d1f3b1a1902a96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5f36 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787604106.129017:0:15036:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8cac89, blocks: 0x1 00010000:00010000:1.0:1787604106.129037:0:15036:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1787604106.129041:0:15036:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787604106.129050:0:15036:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000048df128/0xb5d1f3b1a1902a96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f36 expref: 7 pid: 15036 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.129069:0:15036:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000048df128/0xb5d1f3b1a1902a96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f36 expref: 7 pid: 15036 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.129101:0:15036:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2bec7f800, rc 0) 00000100:00100000:1.0:1787604106.129337:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2bf6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75376845-43d4-452b-be27-6d742e8a3513+7:2364:x1874438345844992:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 386us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604106.129345:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:1.0:1787604106.133381:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.133479:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345845248 00000100:00100000:0.0:1787604106.133489:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345845248 00000100:00100000:0.0:1787604106.133550:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 50 00000100:00100000:0.0:1787604106.133570:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+31:14495:x1874438345845248:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787604106.133682:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+31:14495:x1874438345845248:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 123us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604106.133690:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 50 00000100:00100000:3.0:1787604106.142506:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604106.143897:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345845376 00000100:00100000:1.0:1787604106.143910:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345845376 00000100:00100000:1.0:1787604106.143983:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 51 00000100:00100000:1.0:1787604106.143995:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+31:14495:x1874438345845376:12345-192.168.202.21@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787604106.257551:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1787604106.257573:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787604106.257602:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1787604106.257621:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1787604106.257646:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1787604106.257668:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1787604106.259084:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355262720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787604106.259255:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604106.259258:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75376845-43d4-452b-be27-6d742e8a3513+14:14495:x1874438345845376:12345-192.168.202.21@tcp:44:lhsmtool_posix.0 Request processed in 115263us (116759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604106.259268:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 51 00000100:00100000:1.0:1787604106.259304:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355262720 00000100:00100000:1.0:1787604106.259310:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355262720 00000100:00080000:0.0:1787604106.259351:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787604106.259367:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787604106.259376:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355262720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787604106.259548:0:15035:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787604106.259552:0:15035:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787604106.259566:0:15035:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787604106.259568:0:15035:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787604105 -> 1787604105 00002000:00010000:1.0:1787604106.259570:0:15035:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787604106.259619:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874438355262720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (364us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787604106.259625:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1787604106.262446:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed285d18700/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787604106.262461:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355262720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787604106.266319:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.266575:0:16579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345845504 00000100:00100000:0.0:1787604106.266585:0:16579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345845504 00000100:00100000:0.0:1787604106.266649:0:16579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15 00000100:00100000:0.0:1787604106.266661:0:16579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75376845-43d4-452b-be27-6d742e8a3513+7:2363:x1874438345845504:12345-192.168.202.21@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787604106.266770:0:16579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75376845-43d4-452b-be27-6d742e8a3513+7:2363:x1874438345845504:12345-192.168.202.21@tcp:16:lhsmtool_posix.0 Request processed in 111us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604106.266778:0:16579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15 00000100:00100000:3.0:1787604106.271337:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.271453:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345845760 00000100:00100000:0.0:1787604106.271464:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345845760 00000100:00100000:0.0:1787604106.271523:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 52 00000100:00100000:0.0:1787604106.271534:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+14:14495:x1874438345845760:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787604106.271598:0:16376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604106.271626:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963e00/0xb5d1f3b1a1902a8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f2f expref: 14 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.271645:0:16376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:0.0:1787604106.271651:0:16376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787604106.271680:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.271709:0:16376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.271720:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787604106.271969:0:16376:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2d27d41 reply state 000000003a16d721 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604106.271979:0:16376:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787604106.272072:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+15:14495:x1874438345845760:12345-192.168.202.21@tcp:36:lhsmtool_posix.0 Request processed in 538us (744us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787604106.272079:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 52 00010000:00010000:1.0:1787604106.275805:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.275823:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.275830:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.275868:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff5200 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:1.0:1787604106.275874:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.275882:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a9d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.275899:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:1.0:1787604106.275902:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604106.275907:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a9d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.275913:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff5200/0xb5d1f3b1a1902a9d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604106.277457:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604106.277548:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345845888 00000100:00100000:2.0:1787604106.277566:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345845888 00000100:00100000:2.0:1787604106.277625:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:2.0:1787604106.277637:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75376845-43d4-452b-be27-6d742e8a3513+7:14495:x1874438345845888:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787604106.277655:0:15035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604106.277676:0:15035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f60010e791e5f3d expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.277706:0:15035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000048df128/0xb5d1f3b1a1902a96 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f36 expref: 8 pid: 15036 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.277715:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604106.277719:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604106.277724:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f3d expref: 8 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.277757:0:15035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000048df128/0xb5d1f3b1a1902a96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f36 expref: 8 pid: 15036 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.277770:0:15035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000048df128/0xb5d1f3b1a1902a96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f36 expref: 8 pid: 15036 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604106.277783:0:15035:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15035:1874438355262848:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787604106.277886:0:15035:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286a96480 going to sleep for 11 seconds 00000100:00100000:3.0:1787604106.281964:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.282210:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345846016 00000100:00100000:0.0:1787604106.282219:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345846016 00010000:00010000:0.0:1787604106.282263:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000048df128/0xb5d1f3b1a1902a96 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f36 expref: 9 pid: 15036 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604106.282315:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 13 00000100:00100000:0.0:1787604106.282326:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75376845-43d4-452b-be27-6d742e8a3513+9:2363:x1874438345846016:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604106.282343:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604106.282367:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000048df128/0xb5d1f3b1a1902a96 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f36 expref: 9 pid: 15036 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.282382:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000048df128/0xb5d1f3b1a1902a96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f36 expref: 9 pid: 15036 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.282434:0:14339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604106.282440:0:14339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604106.282447:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f3d expref: 9 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.282457:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f3d expref: 9 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.282497:0:14339:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f3d expref: 9 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604106.282512:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14339:1874438355262976:192.168.202.21@tcp:105: 00000100:00100000:0.0:1787604106.282629:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bb18f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787604106.284791:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14339:1874438355262976:192.168.202.21@tcp:105: 00010000:00010000:0.0:1787604106.284814:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604106.284974:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75376845-43d4-452b-be27-6d742e8a3513+9:2363:x1874438345846016:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 2648us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604106.284992:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 13 00010000:00010000:2.0:1787604106.285591:0:15035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000048df128/0xb5d1f3b1a1902a96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f36 expref: 8 pid: 15036 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604106.285627:0:15035:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15035:1874438355262848:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604106.285650:0:15035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f3d expref: 7 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.285665:0:15035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2b4963e00, rc 0) 00000100:00100000:2.0:1787604106.285692:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75376845-43d4-452b-be27-6d742e8a3513+7:14495:x1874438345845888:12345-192.168.202.21@tcp:101:lhsmtool_posix.0 Request processed in 8057us (8243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604106.285698:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 16 00000100:00100000:3.0:1787604106.289432:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.289505:0:16579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345846144 00000100:00100000:0.0:1787604106.289515:0:16579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345846144 00000100:00100000:0.0:1787604106.289584:0:16579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:0.0:1787604106.289595:0:16579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75376845-43d4-452b-be27-6d742e8a3513+7:2364:x1874438345846144:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787604106.289785:0:16579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787604106.289789:0:16579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787604105 00002000:00010000:0.0:1787604106.289804:0:16579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787604104 00002000:00010000:0.0:1787604106.289806:0:16579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787604105 -> 1787604105 00002000:00010000:0.0:1787604106.289808:0:16579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787604106.300132:0:16579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75376845-43d4-452b-be27-6d742e8a3513+8:2364:x1874438345846144:12345-192.168.202.21@tcp:2:lhsmtool_posix.0 Request processed in 10525us (10694us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787604106.300148:0:16579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:1.0:1787604106.304119:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.305644:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345846272 00000100:00100000:0.0:1787604106.305657:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345846272 00000100:00100000:0.0:1787604106.305724:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 18 00000100:00100000:0.0:1787604106.305735:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75376845-43d4-452b-be27-6d742e8a3513+8:2363:x1874438345846272:12345-192.168.202.21@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787604106.305779:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.305801:0:15033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f3d expref: 8 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.305811:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604106.305815:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787604106.305820:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.305893:0:15033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f3d expref: 8 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.305908:0:15033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f3d expref: 8 pid: 15035 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604106.305943:0:15033:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15033:1874438355263104:192.168.202.21@tcp:104: 00000100:00100000:0.0:1787604106.306022:0:15033:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bb18f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787604106.311039:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.311219:0:15033:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15033:1874438355263104:192.168.202.21@tcp:104: 00010000:00010000:0.0:1787604106.311246:0:15033:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604106.311639:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345846400 00000100:00100000:1.0:1787604106.311647:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345846400 00010000:00010000:1.0:1787604106.311684:0:14338:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f3d expref: 9 pid: 15035 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604106.311726:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 14 00000100:00100000:1.0:1787604106.311748:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75376845-43d4-452b-be27-6d742e8a3513+9:2363:x1874438345846400:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604106.311763:0:14338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604106.311786:0:14338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f3d expref: 9 pid: 15035 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.311802:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f3d expref: 9 pid: 15035 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.311827:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a37e37f/0xb5d1f3b1a1902aa4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f3d expref: 9 pid: 15035 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.311887:0:14338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787604106.311892:0:14338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787604106.311898:0:14338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.311908:0:14338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.311936:0:14338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604106.311989:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75376845-43d4-452b-be27-6d742e8a3513+8:2363:x1874438345846400:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 242us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604106.311997:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 14 00010000:00010000:3.0:1787604106.313457:0:15033:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.313475:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.313508:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.313517:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.313546:0:15033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.313562:0:15033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff4200 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604106.313568:0:15033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.313576:0:15033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.313593:0:15033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.313600:0:15033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d46ed814/0xb5d1f3b1a1902aab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604106.313684:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75376845-43d4-452b-be27-6d742e8a3513+7:2363:x1874438345846272:12345-192.168.202.21@tcp:1:lhsmtool_posix.0 Request processed in 7947us (9570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604106.314693:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 18 00000100:00100000:3.0:1787604106.326766:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604106.327290:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345846656 00000100:00100000:2.0:1787604106.327303:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345846656 00000100:00100000:2.0:1787604106.327367:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 53 00000100:00100000:2.0:1787604106.327378:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+14:14495:x1874438345846656:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787604106.327474:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902ab2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.327490:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.327501:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.327772:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.327784:0:14353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a81 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f28 expref: 15 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.327804:0:14353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.327870:0:14353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f28 expref: 15 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.327884:0:14353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f28 expref: 15 pid: 14353 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604106.327898:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2bf31d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874438355263232:192.168.202.21@tcp:104: 00000100:00100000:2.0:1787604106.327976:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed286a96000 going to sleep for 11 seconds 00000100:00100000:3.0:1787604106.335832:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604106.335938:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345846784 00000100:00100000:1.0:1787604106.335948:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345846784 00010000:00010000:1.0:1787604106.335986:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a81 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f28 expref: 16 pid: 14353 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604106.336031:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 15 00000100:00100000:1.0:1787604106.336041:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75376845-43d4-452b-be27-6d742e8a3513+16:2364:x1874438345846784:12345-192.168.202.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604106.336057:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604106.336065:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a81 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f28 expref: 16 pid: 14353 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.336077:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f28 expref: 16 pid: 14353 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.336110:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:1.0:1787604106.336116:0:14337:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.336126:0:14337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.336133:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.336151:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604106.336213:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75376845-43d4-452b-be27-6d742e8a3513+16:2364:x1874438345846784:12345-192.168.202.21@tcp:103:ldlm_bl.0 Request processed in 173us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604106.336220:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 15 00010000:00010000:2.0:1787604106.336683:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902a81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f28 expref: 15 pid: 14353 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604106.336701:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2bf31d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874438355263232:192.168.202.21@tcp:104: 00010000:00010000:2.0:1787604106.336722:0:14353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.336731:0:14353:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.336737:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787604106.336968:0:14353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787604106.341517:0:14353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787604106.341662:0:14353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787604106.341757:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14353:1874438355263360:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787604106.341898:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604106.341934:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bb18f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604106.342112:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355263360 00000100:00100000:2.0:1787604106.342121:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355263360 00000100:00100000:2.0:1787604106.342175:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787604106.342184:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14353:x1874438355263360:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787604106.342255:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14353:x1874438355263360:12345-0@lo:1000:mdt00_001.0 Request processed in 72us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604106.342263:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787604106.342984:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14353:1874438355263360:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787604106.344240:0:14353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787604106.344328:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14353:1874438355263488:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787604106.344384:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604106.344608:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bb18ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787604106.347522:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355263488 00000100:00100000:3.0:1787604106.347536:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355263488 00000100:00100000:3.0:1787604106.347612:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787604106.347623:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14353:x1874438355263488:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787604106.349107:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14353:x1874438355263488:12345-0@lo:1000:mdt00_001.0 Request processed in 1480us (4718us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787604106.349118:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787604106.349512:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14353:1874438355263488:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787604106.349566:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349578:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349585:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349602:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962c00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604106.349606:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349613:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349630:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:0.0:1787604106.349633:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787604106.349638:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349645:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962c00/0xb5d1f3b1a1902ab9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349680:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1902a11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349686:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1902a11 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349692:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1902a11 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349697:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963600 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604106.349700:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1902a11 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349706:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1902a11 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349725:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:0.0:1787604106.349727:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787604106.349734:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4800/0xb5d1f3b1a1902a18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f0c expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349745:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4800/0xb5d1f3b1a1902a18 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f0c expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349755:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4800/0xb5d1f3b1a1902a18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f0c expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.349814:0:14353:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4800/0xb5d1f3b1a1902a18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.21@tcp remote: 0x7f60010e791e5f0c expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604106.349829:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba1a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874438355263616:192.168.202.21@tcp:105: 00000100:00100000:0.0:1787604106.350015:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ed2bb18fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787604106.361638:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604106.361796:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345846912 00000100:00100000:2.0:1787604106.361806:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345846912 00000100:00100000:2.0:1787604106.361886:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:2.0:1787604106.361896:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285ea7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75376845-43d4-452b-be27-6d742e8a3513+19:14494:x1874438345846912:12345-192.168.202.21@tcp:49:dd.0 00000100:00100000:2.0:1787604106.362033:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285ea7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75376845-43d4-452b-be27-6d742e8a3513+19:14494:x1874438345846912:12345-192.168.202.21@tcp:49:dd.0 Request processed in 137us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604106.362041:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 10 00000100:00100000:0.0:1787604106.362165:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba1a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874438355263616:192.168.202.21@tcp:105: 00010000:00010000:0.0:1787604106.362190:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1902a11 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362202:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963600/0xb5d1f3b1a1902a11 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362232:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902ac0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362247:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902ac0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362272:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902ac0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362282:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902ac0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362299:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902ac0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362306:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902ac0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362311:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff4400 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604106.362315:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902ac0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362321:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902ac0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362331:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:0.0:1787604106.362334:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604106.362337:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902ac0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362342:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b9ff4400/0xb5d1f3b1a1902ac0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362351:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362358:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902ab2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362369:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362373:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963c00 already unused, calling callback (ffffffffc22204f0) 00010000:00010000:0.0:1787604106.362376:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362382:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902ab2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362388:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ed2b2e8b600) 00010000:00010000:0.0:1787604106.362391:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787604106.362402:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902ab2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.362408:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4963c00/0xb5d1f3b1a1902ab2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604106.362596:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75376845-43d4-452b-be27-6d742e8a3513+18:14495:x1874438345846656:12345-192.168.202.21@tcp:57:lhsmtool_posix.0 Request processed in 35219us (35839us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787604106.362604:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 53 00000020:00080000:0.0:1787604106.362608:0:14353:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787604106.362817:0:14384:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787604106.362822:0:14384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787604106.362886:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787604106.362895:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787604106.372066:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604106.372169:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345847168 00000100:00100000:2.0:1787604106.372179:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345847168 00000100:00100000:2.0:1787604106.372240:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 11 00000100:00100000:2.0:1787604106.372251:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75376845-43d4-452b-be27-6d742e8a3513+18:14495:x1874438345847168:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787604106.373229:0:14356:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787604106.373616:0:14356:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787604106.373668:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902ac7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.373686:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902ac7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.373709:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902ac7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.373719:0:14356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902ac7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.373725:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902ac7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.373732:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902ac7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.373756:0:14356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604106.373938:0:15692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604106.373945:0:15692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902ac7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.373952:0:15692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4962e00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604106.373957:0:15692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902ac7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.373964:0:15692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902ac7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.373976:0:15692:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ed290d35400) 00010000:00010000:3.0:1787604106.373979:0:15692:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787604106.373984:0:15692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902ac7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.373990:0:15692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2b4962e00/0xb5d1f3b1a1902ac7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.374002:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604106.374004:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604106.374006:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604106.374058:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75376845-43d4-452b-be27-6d742e8a3513+20:14495:x1874438345847168:12345-192.168.202.21@tcp:35:lhsmtool_posix.0 Request processed in 1805us (1998us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787604106.374068:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 11 00000020:00080000:2.0:1787604106.374074:0:14356:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787604106.530281:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604106.530331:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:3.0:1787604106.530369:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.530683:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345847296 00000100:00100000:0.0:1787604106.530695:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345847296 00000100:00100000:0.0:1787604106.530744:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345847424 00000100:00100000:0.0:1787604106.530748:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345847424 00000100:00100000:0.0:1787604106.530761:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345847552 00000100:00100000:0.0:1787604106.530764:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345847552 00000100:00100000:0.0:1787604106.530778:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:0.0:1787604106.530788:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75376845-43d4-452b-be27-6d742e8a3513+9:2365:x1874438345847296:12345-192.168.202.21@tcp:4:dd.0 00002000:00010000:0.0:1787604106.530882:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8cac89, atime: 0x6a8cac88, ctime: 0x6a8cac89, blocks: 0x1 00010000:00010000:0.0:1787604106.530891:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000523a9578/0xb5d1f3b1a1902ace lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.530906:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1787604106.530910:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604106.530916:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000523a9578/0xb5d1f3b1a1902ace lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.530929:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000523a9578/0xb5d1f3b1a1902ace lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604106.535414:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:2.0:1787604106.535589:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787604106.535598:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787604106.537196:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345847680 00000100:00100000:1.0:1787604106.537208:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345847680 00000100:00100000:2.0:1787604106.538251:0:16582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 1 00000100:00100000:2.0:1787604106.538265:0:16582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75376845-43d4-452b-be27-6d742e8a3513+10:2365:x1874438345847424:12345-192.168.202.21@tcp:4:dd.0 00010000:00010000:2.0:1787604106.539388:0:16582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a1902ad5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.540295:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604106.540300:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604106.540308:0:16582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a1902ad5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604106.540342:0:16582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a1902ad5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604106.548787:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604106.548965:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604106.548997:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:1.0:1787604106.549012:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604106.549089:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787604106.549099:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1787604106.549634:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345848064 00000100:00100000:1.0:1787604106.549644:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345848064 00000100:00100000:1.0:1787604106.549699:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787604106.549705:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345848192 00000100:00100000:1.0:1787604106.549708:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345848192 00000100:00100000:1.0:1787604106.549722:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787604106.549727:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345847936 00000100:00100000:1.0:1787604106.549729:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345847936 00000100:00100000:1.0:1787604106.549739:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787604106.549744:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345847808 00000100:00100000:1.0:1787604106.549746:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345847808 00000100:00100000:0.0:1787604106.550396:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 2 00000100:00100000:0.0:1787604106.550408:0:16583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75376845-43d4-452b-be27-6d742e8a3513+16:2365:x1874438345847552:12345-192.168.202.21@tcp:4:dd.0 00010000:00010000:0.0:1787604106.550449:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0b5b172/0xb5d1f3b1a1902adc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.550466:0:16583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604106.550470:0:16583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604106.550477:0:16583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0b5b172/0xb5d1f3b1a1902adc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604106.550490:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0b5b172/0xb5d1f3b1a1902adc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604106.712865:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787604106.712887:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355263744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787604106.712956:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787604106.715867:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604106.717431:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355263744 00000100:00100000:0.0:1787604106.717446:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355263744 00000100:00100000:0.0:1787604106.717514:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787604106.717527:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874438355263744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787604106.717559:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 59572224 pending 5111808 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787604106.717647:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874438355263744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (4691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604106.717654:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787604106.723005:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355263744:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787604106.747894:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:3.0:1787604106.747906:0:15040:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1787604106.747911:0:15040:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787604105 -> 1787604106 00002000:00010000:3.0:1787604106.747915:0:15040:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787604105 -> 1787604106 00002000:00010000:3.0:1787604106.747918:0:15040:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00000001:00080000:1.0:1787604106.747944:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1787604106.747951:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00010000:00010000:3.0:1787604106.748169:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000523a9578/0xb5d1f3b1a1902ace lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.748184:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000523a9578/0xb5d1f3b1a1902ace lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.748193:0:15040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000523a9578/0xb5d1f3b1a1902ace lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.751544:0:15040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff4c00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604106.751560:0:15040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000523a9578/0xb5d1f3b1a1902ace lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.751574:0:15040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000523a9578/0xb5d1f3b1a1902ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.751595:0:15040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000523a9578/0xb5d1f3b1a1902ace lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.751602:0:15040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000523a9578/0xb5d1f3b1a1902ace lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604106.751705:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75376845-43d4-452b-be27-6d742e8a3513+18:2365:x1874438345847296:12345-192.168.202.21@tcp:4:dd.0 Request processed in 220913us (221428us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787604106.751746:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 0 00000100:00100000:3.0:1787604106.751781:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 3 00000100:00100000:3.0:1787604106.751792:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75376845-43d4-452b-be27-6d742e8a3513+17:2365:x1874438345847680:12345-192.168.202.21@tcp:4:dd.0 00010000:00010000:3.0:1787604106.751825:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5693d48/0xb5d1f3b1a1902ae3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.751870:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604106.751876:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604106.751882:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5693d48/0xb5d1f3b1a1902ae3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.751895:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5693d48/0xb5d1f3b1a1902ae3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787604106.868330:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1787604106.871193:0:16582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1787604106.871206:0:16582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:3.0:1787604106.871225:0:16582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a1902ad5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.871241:0:16582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a1902ad5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.871252:0:16582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a1902ad5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.871565:0:16582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b4963400 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604106.871572:0:16582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a1902ad5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.871582:0:16582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a1902ad5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.871929:0:16582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a1902ad5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.871940:0:16582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036024c5a/0xb5d1f3b1a1902ad5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604106.872067:0:16582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75376845-43d4-452b-be27-6d742e8a3513+15:2365:x1874438345847424:12345-192.168.202.21@tcp:4:dd.0 Request processed in 333799us (341729us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787604106.872078:0:16582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 1 00000100:00100000:3.0:1787604106.872123:0:16582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:3.0:1787604106.872138:0:16582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed285d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75376845-43d4-452b-be27-6d742e8a3513+14:2365:x1874438345848064:12345-192.168.202.21@tcp:4:dd.0 00010000:00010000:3.0:1787604106.872180:0:16582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1c1337e/0xb5d1f3b1a1902aea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.872196:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604106.872201:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604106.872208:0:16582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1c1337e/0xb5d1f3b1a1902aea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.872236:0:16582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1c1337e/0xb5d1f3b1a1902aea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787604106.877887:0:16583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1787604106.877917:0:16583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0b5b172/0xb5d1f3b1a1902adc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.877932:0:16583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0b5b172/0xb5d1f3b1a1902adc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.877941:0:16583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0b5b172/0xb5d1f3b1a1902adc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.877948:0:16583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2b9ff5000 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787604106.877970:0:16583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0b5b172/0xb5d1f3b1a1902adc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.877980:0:16583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0b5b172/0xb5d1f3b1a1902adc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.878004:0:16583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0b5b172/0xb5d1f3b1a1902adc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.878011:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0b5b172/0xb5d1f3b1a1902adc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604106.878087:0:16583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75376845-43d4-452b-be27-6d742e8a3513+14:2365:x1874438345847552:12345-192.168.202.21@tcp:4:dd.0 Request processed in 327674us (347710us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787604106.878099:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 2 00000100:00100000:1.0:1787604106.878142:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 5 00000100:00100000:1.0:1787604106.878157:0:16583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75376845-43d4-452b-be27-6d742e8a3513+13:2365:x1874438345848192:12345-192.168.202.21@tcp:4:dd.0 00010000:00010000:1.0:1787604106.878199:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1902af1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.878213:0:16583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787604106.878218:0:16583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787604106.878227:0:16583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1902af1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604106.878239:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1902af1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787604106.983170:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1787604106.983299:0:15040:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00010000:00010000:3.0:1787604106.983323:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5693d48/0xb5d1f3b1a1902ae3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.983339:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5693d48/0xb5d1f3b1a1902ae3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.983350:0:15040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5693d48/0xb5d1f3b1a1902ae3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.983359:0:15040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217de00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604106.983365:0:15040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5693d48/0xb5d1f3b1a1902ae3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.983377:0:15040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5693d48/0xb5d1f3b1a1902ae3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.983419:0:15040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5693d48/0xb5d1f3b1a1902ae3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.983428:0:15040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5693d48/0xb5d1f3b1a1902ae3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604106.983621:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75376845-43d4-452b-be27-6d742e8a3513+15:2365:x1874438345847680:12345-192.168.202.21@tcp:4:dd.0 Request processed in 231824us (448208us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787604106.983635:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 3 00000100:00100000:3.0:1787604106.983682:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 6 00000100:00100000:3.0:1787604106.983699:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75376845-43d4-452b-be27-6d742e8a3513+14:2366:x1874438345847936:12345-192.168.202.21@tcp:4:dd.0 00010000:00010000:3.0:1787604106.983742:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000310eeb3c/0xb5d1f3b1a1902af8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.983758:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787604106.983763:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604106.983770:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000310eeb3c/0xb5d1f3b1a1902af8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604106.983784:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000310eeb3c/0xb5d1f3b1a1902af8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787604107.052234:0:16582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1787604107.052267:0:16582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1c1337e/0xb5d1f3b1a1902aea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604107.052346:0:16582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1c1337e/0xb5d1f3b1a1902aea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604107.052357:0:16582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1c1337e/0xb5d1f3b1a1902aea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604107.052366:0:16582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217d400 already unused, calling callback (ffffffffc1816230) 00010000:00010000:1.0:1787604107.052372:0:16582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1c1337e/0xb5d1f3b1a1902aea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604107.052385:0:16582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1c1337e/0xb5d1f3b1a1902aea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604107.052474:0:16582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1c1337e/0xb5d1f3b1a1902aea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604107.052484:0:16582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1c1337e/0xb5d1f3b1a1902aea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604107.052723:0:16582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed285d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75376845-43d4-452b-be27-6d742e8a3513+16:2365:x1874438345848064:12345-192.168.202.21@tcp:4:dd.0 Request processed in 180583us (503938us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787604107.052757:0:16582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 4 00000100:00100000:1.0:1787604107.052800:0:16582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 7 00000100:00100000:1.0:1787604107.052814:0:16582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75376845-43d4-452b-be27-6d742e8a3513+15:2366:x1874438345847808:12345-192.168.202.21@tcp:4:dd.0 00010000:00010000:1.0:1787604107.052897:0:16582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1902aff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604107.052911:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787604107.052916:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787604107.052924:0:16582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1902aff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604107.052938:0:16582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1902aff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.053437:0:16583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1902af1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.053449:0:16583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1902af1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.053457:0:16583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1902af1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.053477:0:16583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7f000 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604107.053483:0:16583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1902af1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.053491:0:16583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1902af1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.053505:0:16583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1902af1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.053513:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ff6b885/0xb5d1f3b1a1902af1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604107.053566:0:16583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:75376845-43d4-452b-be27-6d742e8a3513+15:2365:x1874438345848192:12345-192.168.202.21@tcp:4:dd.0 Request processed in 175414us (504600us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787604107.053574:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 5 00000001:00080000:3.0:1787604107.053970:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:3.0:1787604107.053993:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1787604107.159824:0:15040:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1787604107.159898:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000310eeb3c/0xb5d1f3b1a1902af8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.159913:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000310eeb3c/0xb5d1f3b1a1902af8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.159923:0:15040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000310eeb3c/0xb5d1f3b1a1902af8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.159952:0:15040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2c217c600 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604107.159957:0:15040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000310eeb3c/0xb5d1f3b1a1902af8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.159966:0:15040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000310eeb3c/0xb5d1f3b1a1902af8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.159987:0:15040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000310eeb3c/0xb5d1f3b1a1902af8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.159995:0:15040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000310eeb3c/0xb5d1f3b1a1902af8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604107.160088:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:75376845-43d4-452b-be27-6d742e8a3513+11:2366:x1874438345847936:12345-192.168.202.21@tcp:4:dd.0 Request processed in 176391us (611085us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787604107.160098:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 6 00000001:00080000:3.0:1787604107.160140:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:0.0:1787604107.228392:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:3.0:1787604107.228556:0:16582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1902aff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.228572:0:16582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1902aff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.228581:0:16582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1902aff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.228606:0:16582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2bec7ec00 already unused, calling callback (ffffffffc1816230) 00010000:00010000:3.0:1787604107.228612:0:16582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1902aff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.228622:0:16582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1902aff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.228643:0:16582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1902aff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604107.228650:0:16582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c50de2e/0xb5d1f3b1a1902aff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604107.228748:0:16582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:75376845-43d4-452b-be27-6d742e8a3513+5:2366:x1874438345847808:12345-192.168.202.21@tcp:4:dd.0 Request processed in 175934us (679730us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787604107.228768:0:16582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 7 00010000:00010000:0.0:1787604107.736465:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604108.251101:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355264000:0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.251168:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604108.251214:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2af73ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355264512:0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.251236:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604108.251259:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787604108.252413:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e30912c-ffd9-4190-a569-23df3a025820:3284:1874438355263872:0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.252456:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604108.252489:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355264384:0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.252519:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604108.252561:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355264128:0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.252586:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604108.252607:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787604108.252614:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed285d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355264256:0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.252636:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604108.252667:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355264000 00000100:00100000:3.0:1787604108.252674:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355264000 00000100:00100000:3.0:1787604108.252721:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355264128 00000100:00100000:3.0:1787604108.252724:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355264128 00000100:00100000:3.0:1787604108.252745:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787604108.252754:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355264000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.252805:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874438355264000:12345-0@lo:400:kworker.0 Request processed in 52us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604108.252812:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787604108.252828:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787604108.252834:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355264128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.252878:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874438355264128:12345-0@lo:400:kworker.0 Request processed in 44us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604108.252883:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787604108.252900:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355264512 00000100:00100000:3.0:1787604108.252904:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355264512 00000100:00100000:3.0:1787604108.252930:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355264384 00000100:00100000:3.0:1787604108.252933:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355264384 00000100:00100000:3.0:1787604108.252944:0:16376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355264256 00000100:00100000:3.0:1787604108.252947:0:16376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355264256 00000100:00100000:3.0:1787604108.252958:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787604108.252964:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355264512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.252999:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874438355264512:12345-0@lo:400:kworker.0 Request processed in 35us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604108.253005:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787604108.253017:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787604108.253022:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355264384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.253045:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874438355264384:12345-0@lo:400:kworker.0 Request processed in 23us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604108.253049:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787604108.253058:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787604108.253063:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2af73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355264256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.253082:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2af73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874438355264256:12345-0@lo:400:kworker.0 Request processed in 20us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604108.253087:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787604108.253104:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355263872 00000100:00100000:3.0:1787604108.253108:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355263872 00000100:00100000:3.0:1787604108.253132:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787604108.253138:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+19:3284:x1874438355263872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.253164:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e30912c-ffd9-4190-a569-23df3a025820+19:3284:x1874438355263872:12345-0@lo:400:kworker.0 Request processed in 27us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604108.253170:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1787604108.253200:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787604108.253204:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787604108.253206:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604108.253242:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874438355264256:0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.253250:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3281:1874438355264128:0@lo:400:kworker.0 00000100:00100000:1.0:1787604108.253790:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787604108.253799:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2ba15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355264640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787604108.253829:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604108.253868:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438355264640 00000100:00100000:1.0:1787604108.253872:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438355264640 00000100:00100000:1.0:1787604108.253896:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787604108.253902:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355264640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787604108.253928:0:15037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604108.253963:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874438355264640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604108.253969:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787604108.254010:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2ba15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3282:1874438355264640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787604108.255632:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e30912c-ffd9-4190-a569-23df3a025820:3284:1874438355263872:0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.255649:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3284:1874438355264384:0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.255659:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1787604108.255664:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed285d18700, transno 8589934595 00000004:00080000:3.0:1787604108.255686:0:3284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1787604108.255700:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed285d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3284:1874438355264000:0@lo:400:kworker.0 00000100:00100000:3.0:1787604108.255712:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ed2af73ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3284:1874438355264512:0@lo:400:kworker.0 00000040:00080000:0.0:1787604108.451679:0:14384:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787604108.451689:0:14384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787604108.451721:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787604108.451727:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:2.0:1787604108.574126:0:16622:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1787604108.589219:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604108.589266:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604108.589297:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604108.589411:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604108.589434:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604108.589456:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604108.589475:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.21@tcp (source: 12345-192.168.202.21@tcp) 00000100:00100000:0.0:1787604108.589502:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345848832 00000100:00100000:0.0:1787604108.589512:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345848832 00000100:00100000:0.0:1787604108.589579:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345848448 00000100:00100000:0.0:1787604108.589582:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345848448 00000100:00100000:0.0:1787604108.589607:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 29 00000100:00100000:0.0:1787604108.589617:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:2365:x1874438345848832:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604108.589798:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00100000:1.0:1787604108.589809:0:16376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+20:2365:x1874438345848448:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:1.0:1787604108.589866:0:16376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75376845-43d4-452b-be27-6d742e8a3513+20:2365:x1874438345848448:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 60us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604108.589874:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 30 00000100:00100000:0.0:1787604108.590001:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+6:2365:x1874438345848832:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 85us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604108.590008:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 29 00000100:00100000:0.0:1787604108.590028:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345848576 00000100:00100000:0.0:1787604108.590032:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345848576 00000100:00100000:0.0:1787604108.590051:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345849088 00000100:00100000:0.0:1787604108.590054:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345849088 00000100:00100000:0.0:1787604108.590066:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345848704 00000100:00100000:0.0:1787604108.590069:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345848704 00000100:00100000:0.0:1787604108.590079:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345848960 00000100:00100000:0.0:1787604108.590081:0:15035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345848960 00000100:00100000:0.0:1787604108.590093:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:0.0:1787604108.590098:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75376845-43d4-452b-be27-6d742e8a3513+5:2365:x1874438345848576:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787604108.590126:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75376845-43d4-452b-be27-6d742e8a3513+5:2365:x1874438345848576:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 27us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604108.590132:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 17 00000100:00100000:0.0:1787604108.590142:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 18 00000100:00100000:0.0:1787604108.590147:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2365:x1874438345849088:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787604108.590168:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2365:x1874438345849088:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 21us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604108.590174:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 18 00000100:00100000:0.0:1787604108.590185:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:0.0:1787604108.590191:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75376845-43d4-452b-be27-6d742e8a3513+5:2365:x1874438345848704:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787604108.590210:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75376845-43d4-452b-be27-6d742e8a3513+5:2365:x1874438345848704:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 20us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604108.590226:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 19 00000100:00100000:0.0:1787604108.590237:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00100000:0.0:1787604108.590244:0:15035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2ba1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2365:x1874438345848960:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:0.0:1787604108.590265:0:15035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2ba1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee6601d0-b3cd-4fa5-8064-db2f3416d82f+5:2365:x1874438345848960:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 22us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604108.590271:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 20 00000100:00080000:0.0:1787604108.590292:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787604108.590297:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787604108.590299:0:14348:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787604108.590589:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438345848320 00000100:00100000:2.0:1787604108.590594:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438345848320 00000100:00100000:2.0:1787604108.590632:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.21@tcp, seq: 124 00000100:00100000:2.0:1787604108.590639:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed286420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:2365:x1874438345848320:12345-192.168.202.21@tcp:400:kworker.0 00000100:00100000:2.0:1787604108.590666:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed286420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33d6c8a-c34b-49f6-b7db-7724c3e70a96+13:2365:x1874438345848320:12345-192.168.202.21@tcp:400:kworker.0 Request processed in 28us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604108.590673:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.21@tcp, seq: 124 00010000:00010000:3.0:1787604108.760132:0:15692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604109.783187:0:14340:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29369 lines, 29369 kept, 0 dropped, 0 bad.